mysql - Is Apache Hadoop 2.7.1 is compatible with Apache Sqoop 1.4.6? -

-

i have installed apache hadoop 2.7.1 , integrate apache sqoop 1.4.6. when trying import mysql database hive using sqoop commands :

sqoop import \ --connect "jdbc:mysql://localhost:3306/assignment5" \ --username root \ --password cg \ --table emp_detail \ --fields-terminated-by ',' \ --lines-terminated-by '\n' \ --hive-home /user/hive/warehouse/assignment5.db \ --hive-import  \ --hive-table emp_detail

and getting issue :

  exception in thread "main" java.lang.incompatibleclasschangeerror: found interface org.apache.hadoop.mapreduce.jobcontext, class expected             @ org.apache.sqoop.config.configurationhelper.getjobnummaps(configurationhelper.java:65)             @ com.cloudera.sqoop.config.configurationhelper.getjobnummaps(configurationhelper.java:36)             @ org.apache.sqoop.mapreduce.db.datadrivendbinputformat.getsplits(datadrivendbinputformat.java:125)             @ org.apache.hadoop.mapreduce.jobsubmitter.writenewsplits(jobsubmitter.java:301)             @ org.apache.hadoop.mapreduce.jobsubmitter.writesplits(jobsubmitter.java:318)             @ org.apache.hadoop.mapreduce.jobsubmitter.submitjobinternal(jobsubmitter.java:196)             @ org.apache.hadoop.mapreduce.job$10.run(job.java:1290)             @ org.apache.hadoop.mapreduce.job$10.run(job.java:1287)             @ java.security.accesscontroller.doprivileged(native method)             @ javax.security.auth.subject.doas(subject.java:422)             @ org.apache.hadoop.security.usergroupinformation.doas(usergroupinformation.java:1657)             @ org.apache.hadoop.mapreduce.job.submit(job.java:1287)             @ org.apache.hadoop.mapreduce.job.waitforcompletion(job.java:1308)             @ org.apache.sqoop.mapreduce.importjobbase.dosubmitjob(importjobbase.java:196)             @ org.apache.sqoop.mapreduce.importjobbase.runjob(importjobbase.java:169)             @ org.apache.sqoop.mapreduce.importjobbase.runimport(importjobbase.java:266)             @ org.apache.sqoop.manager.sqlmanager.importtable(sqlmanager.java:673)             @ org.apache.sqoop.tool.importtool.importtable(importtool.java:497)             @ org.apache.sqoop.tool.importtool.run(importtool.java:605)             @ org.apache.sqoop.sqoop.run(sqoop.java:143)             @ org.apache.hadoop.util.toolrunner.run(toolrunner.java:70)             @ org.apache.sqoop.sqoop.runsqoop(sqoop.java:179)             @ org.apache.sqoop.sqoop.runtool(sqoop.java:218)             @ org.apache.sqoop.sqoop.runtool(sqoop.java:227)             @ org.apache.sqoop.sqoop.main(sqoop.java:236)

could tell me issue means?

indeed seems suffering version conflicts.

answering first question compatibility. yes running

hadoop 2.7.1.2.4.0.0-169

sqoop 1.4.6.2.4.0.0-169

and work together.

trying answer second question.

i check running 2 versions by

hadoop version sqoop version

apart thing might add import sentence, (probably not related problem) specify connection driver. mysql use

--driver com.mysql.jdbc.driver

however, not sure issue related driver. there more info drivers @ sqoop page

but coming initial question compatibility. pretty sure compatible.

i rather check actual versions running on system , calls.

for more info changes on hadoop across versions can check answer.


Comments

Post a Comment

Popular posts from this blog

Spring Boot + JPA + Hibernate: Unable to locate persister -

-
i trying work entity inside request method of spring boot application. entity in project , pom.xml has dependencies it. why error message?: org.hibernate.unknownentitytypeexception: unable locate persister: com.ric.bill.model.bs.par package com.ric.web; import java.util.concurrent.atomic.atomiclong; import javax.persistence.entitymanager; import javax.persistence.persistencecontext; import net.sf.ehcache.cachemanager; import net.sf.ehcache.management.cache; import net.sf.ehcache.management.cachestatistics; import org.hibernate.stat.statistics; import org.springframework.beans.factory.annotation.autowired; import org.springframework.boot.autoconfigure.domain.entityscan; import org.springframework.cache.annotation.enablecaching; import org.springframework.transaction.annotation.enabletransactionmanagement; import org.springframework.transaction.annotation.propagation; import org.springframework.transaction.annotation.transactional; import org.springframework.web.bind.annotati
Read more

go - Golang: panic: runtime error: invalid memory address or nil pointer dereference using bufio.Scanner -

-
i implementing go program uses bufio.scanner , bufio.writer have packaged code follows package main import ( "fmt" "player/command" "strings" ) func main() { //enter code here. read input stdin. print output stdout commands.scanner.scan() { //scan new line , send comand variable check command exist or not input := strings.split(strings.trim(commands.scanner.text(), " "), " ") command := input[0] if command == "" { fmt.printf("$ %s:", commands.pwd) continue } if !commands.commands[command] { commands.throwerror("cannot recognize input.") } else { commands.execute(command, input[1:], nil) } fmt.printf("$ %s:", commands.pwd) } } i using init.go file in main package follows package main import ( "flag" "player/sourc
Read more

c - double free or corruption (fasttop) -

-
this code reads null terminated string file (file containing null terminated strings & should provide index wanted string). error: *** error in `./main': double free or corruption (fasttop): 0x090a4a80 *** aborted code: char *tmp_realloc=null; char *sstring=null; int i=1; /*set file pointer point string*/ fseek(fh,index,seek_set); sstring=(char*)malloc(sizeof(char)); if(sstring == null) return null; tmp_realloc=sstring; while( (*(sstring+i-1)=(char)fgetc((file*)fh)) != 0x0 ) { /*reallocate more memory*/ tmp_realloc=(char*)realloc((char*)sstring,++i); /*if not same address copy old new & set old point new*/ if(tmp_realloc != sstring){ strcpy((char*)tmp_realloc,(char*)sstring); free(sstring); sstring=tmp_realloc; } } could tell me pointer causing issue (& reason) ? remove part /*if not same address copy old new & set old point new*/ if(tmp_realloc != sstring){ strc
Read more