Questions tagged [Hadoop] (38)

Welcome. Are there any patterns/best practice for effective storage of rules, consisting of a combination of logical operators? The challenge is to dynamically build the filters for selection of records in the table matching this rule. And also to have the ability to edit rules. Preferably the rules are stored in the table...

Hi all. In impala, you must create a UDF to calculate the hash sums, found the project on github (https://github.com/ScalefreeCOM/impala-crypto-udf) When compiling gives the following error:username@prepatcher-oel7 impala-crypto-udf-master $ make [ 50%] Building CXX object CMakeFiles/udfcrypto.dir/udf-crypto.cc.o In file in...

Hi all, has anyone experienced using Hortonworks Sandbox HDP - Hive add python udf when it is called from cli get: Query with transform clause is disallowed in the current configuration. Authorization is through Ranger, there are all possible rights for the user hive is Apache Hive (version 3.1.0.3.0.1.0-187) It is not clea...

Hi, just rolling into the architecture. You want to deploy the hadoop for data storage, apache spark for processing. How will the architecture from the point of view of the servers? You need a lot of servers and collect them in cluster? Or will one cloud, where everything is spinning? What is the right thing to do?

Hello. Trying to write a client for hive c windows 2012 R2 I HADOOP_HOME Environment for a prescribed next, the prepared codepublic static void main (String args[]) { try { org.apache.hadoop.conf.Configuration conf = new org.apache.hadoop.conf.Configuration(); conf.set("hadoop.security.authentication", "Kerberos"); UserG...

Hello. I want to write Hive client to connect to karbonizirovannogo cluster: found this example code just specify The IDEA is surrounded by windows 2012 R2 the keytab in the local environmentpublic static void main(String[] args) throws IOException, SQLException { try { Class.forName("org.apache.hive.jdbc.HiveDriver"); }...

Zdrastvuyte. We have in a startup there are several tasks that boil down to the classical paradigm of Map Reduce. We want to spread tasks across multiple servers. Which decision is worth watching? You should pay attention to? Now I am thinking about two solutions: 1. famous Hadoop — a lot of talk about him and he is everywh...

Hi all. Taking the first steps in the development of Hadoop. Set up a "cluster" of a pair of virtualos. Can't run the MapReduce task.sudo-uhdfs yarn jar /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar pi 1 1 In the log of ResourceManager-and it comes to this:13/12/10 23:30:02 INFO mapreduce.JobSubmitter: Submitting ...

Hi all. Question about Cloudera-cdh 4 If you use Hue to run Hive queries run time of a simple query:select count(*) from table_name up to 5(!) hours. The download for the cluster nodes is so large that the response in ssh console it takes more than a minute. Testimony loadavg 40 Node1 -- the most powerful node. It still run...

Make course, want to investigate the acceleration of computing "wordcount" to dump Wikipedia(600MB). Before each new run often add a new node($HADOOP_HOME/conf/slaves) OS: ubuntu server 12.04.04, hadoop-1.2.1