Questions tagged [Hadoop] (38)

2
answers

How to store combinations of logical operators in the table?

Welcome. Are there any patterns/best practice for effective storage of rules, consisting of a combination of logical operators? The challenge is to dynamically build the filters for selection of records in the table matching this rule. And also to have the ability to edit rules. Preferably the rules are stored in the table...
bailey.Bogisich asked April 8th 20 at 18:16
0
answer

How to solve the error while compiling UDFs for Impala?

Hi all. In impala, you must create a UDF to calculate the hash sums, found the project on github (https://github.com/ScalefreeCOM/impala-crypto-udf) When compiling gives the following error:username@prepatcher-oel7 impala-crypto-udf-master $ make [ 50%] Building CXX object CMakeFiles/udfcrypto.dir/udf-crypto.cc.o In file in...
Daphne asked April 2nd 20 at 16:13
0
answer

How to call a Python UDF for Hive?

Hi all, has anyone experienced using Hortonworks Sandbox HDP - Hive add python udf when it is called from cli get: Query with transform clause is disallowed in the current configuration. Authorization is through Ranger, there are all possible rights for the user hive is Apache Hive (version 3.1.0.3.0.1.0-187) It is not clea...
Sheila.Weimann asked March 31st 20 at 15:53
0
answer

Hadoop + ApacheSpark deploy cluster?

Hi, just rolling into the architecture. You want to deploy the hadoop for data storage, apache spark for processing. How will the architecture from the point of view of the servers? You need a lot of servers and collect them in cluster? Or will one cloud, where everything is spinning? What is the right thing to do?
Douglas_OReilly asked March 19th 20 at 08:40
0
answer

How to solve the problem javax.security.sasl.SaslException: GSS initiate failed?

Hello. Trying to write a client for hive c windows 2012 R2 I HADOOP_HOME Environment for a prescribed next, the prepared codepublic static void main (String args[]) { try { org.apache.hadoop.conf.Configuration conf = new org.apache.hadoop.conf.Configuration(); conf.set("hadoop.security.authentication", "Kerberos"); UserG...
garrett_Weber asked March 13th 20 at 13:32
1
answer

How to specify gss-jaas.conf?

Hello. I want to write Hive client to connect to karbonizirovannogo cluster: found this example code just specify The IDEA is surrounded by windows 2012 R2 the keytab in the local environmentpublic static void main(String[] args) throws IOException, SQLException { try { Class.forName("org.apache.hive.jdbc.HiveDriver"); }...
Mazie asked March 13th 20 at 13:24
2
answers

Organization Of Map-Reduce?

Zdrastvuyte. We have in a startup there are several tasks that boil down to the classical paradigm of Map Reduce. We want to spread tasks across multiple servers. Which decision is worth watching? You should pay attention to? Now I am thinking about two solutions: 1. famous Hadoop — a lot of talk about him and he is everywh...
leonor.Farre asked October 3rd 19 at 19:21
2
answers

Hadoop: why it is impossible to run a MapReduce task?

Hi all. Taking the first steps in the development of Hadoop. Set up a "cluster" of a pair of virtualos. Can't run the MapReduce task.sudo-uhdfs yarn jar /usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar pi 1 1 In the log of ResourceManager-and it comes to this:13/12/10 23:30:02 INFO mapreduce.JobSubmitter: Submitting ...
Kobe.Goldner99 asked October 2nd 19 at 21:03
0
answer

Why hue runs very slow?

Hi all. Question about Cloudera-cdh 4 If you use Hue to run Hive queries run time of a simple query:select count(*) from table_name up to 5(!) hours. The download for the cluster nodes is so large that the response in ssh console it takes more than a minute. Testimony loadavg 40 Node1 -- the most powerful node. It still run...
Ardella.Jer asked September 27th 19 at 13:46
1
answer

Hadoop MapReduce tutorial, hadoop philosophy: after each "wordcount"and restarted all the daemons?

Make course, want to investigate the acceleration of computing "wordcount" to dump Wikipedia(600MB). Before each new run often add a new node($HADOOP_HOME/conf/slaves) OS: ubuntu server 12.04.04, hadoop-1.2.1
chauncey_Jakubowski asked September 24th 19 at 22:53