java - S2VUtils.getConnectionToVerticaHost(): FATAL ERROR. cound not get connection to any host in list -
i trying connect java based apache spark application vertica database using hpe vertica spark connector , i'm getting following exception. ip address mentioned ip address of vertica vm installed on machine. ip address executing command "ifconfig" on vm.
environment:
- vertica-7.2.3_ovf
- vmware-player-12.1.1-3770994
- windows 10
- apache spark-1.6.2
- hpe-vertica-spark-connector-0.2.2
code:
hashmap<string, string> verticaconnectorproperties = new hashmap<string, string>(); verticaconnectorproperties.put("table", "testtable"); verticaconnectorproperties.put("db", "testdb"); verticaconnectorproperties.put("user", "testuser"); verticaconnectorproperties.put("password", "testpassword"); verticaconnectorproperties.put("host", "192.168.10.10"); // ip of vertica vm installed on machine dataframe.write() .format("com.vertica.spark.datasource.defaultsource") .mode(savemode.overwrite) .options(verticaconnectorproperties) .save();
error:
16/08/08 14:38:57 info s2vutils: current partitions in dataframe=2; s2v default value=16; user option numpartitions=16; final s2v numpartitions save=2 16/08/08 14:38:57 info s2vutils: user options , s2v options validated ok: temp_table=s2v_temp_table_testtable_s2v_job4115324674851267391, strlen=1024, save_mode=overwrite, last_committer_table=s2v_temp_table_testtable_s2v_job4115324674851267391_last_committer, host=192.168.10.10, num_partitions=2, tmpdir=/tmp, db=testdb, empty_count=-1, job_name=s2v_job4115324674851267391, all_done_table=s2v_job_status, commit_tables_prefix=s2v_temp_table_testtable_s2v_job4115324674851267391_commits_partition, dbschema=public, port=5433, autocommit=false, log_rejected_rows_sample_size=10, primary_ip=192.168.10.10, failed_rows_percent_tolerance=0.0, batch_size=100000, user=dbadmin, table=testtable, password=masked 16/08/08 14:38:57 info s2vutils: unique job name:s2v_job4115324674851267391 appear in vertica table: public.s2v_job_status 16/08/08 14:38:57 info s2v: vertica node ips mapping=map(127.0.0.1 -> 127.0.0.1) 16/08/08 14:38:57 info s2v: vertica node ips used connector=list(127.0.0.1) 16/08/08 14:38:58 error s2vutils: error: getconnectiontoverticahost(): connectexception: java.lang.nullpointerexception 16/08/08 14:38:58 error s2vutils: error: connectexception: java.lang.exception: error: s2vutils.getconnectiontoverticahost(): fatal error. cound not connection host in list:'list(127.0.0.1)'. 16/08/08 14:38:58 info s2vutils: createtemptables(): creating temp tables now... 16/08/08 14:38:59 error s2vutils: error: getconnectiontoverticahost(): connectexception: java.lang.nullpointerexception 16/08/08 14:38:59 error s2vutils: error: connectexception: java.lang.exception: error: s2vutils.getconnectiontoverticahost(): fatal error. cound not connection host in list:'list(127.0.0.1)'. 16/08/08 14:39:00 error s2vutils: error: getconnectiontoverticahost(): connectexception: java.lang.nullpointerexception 16/08/08 14:39:00 error s2vutils: error: update statement: create table public.s2v_temp_table_testtable_s2v_job4115324674851267391 (sd_enodeb_name long varchar (1024), sd_managed_object2 long varchar (1024), sd_cell_name long varchar (1024), sd_vendor long varchar (1024), sd_status long varchar (1024), sd_date_onair long varchar (1024), sd_long_wgs84 double precision, sd_lat_wgs84 double precision, sd_height double precision, sd_azimuth double precision, sd_cluster long varchar (1024), sd_operator long varchar (1024), sd_region long varchar (1024), sd_province long varchar (1024), sd_city long varchar (1024), sd_projection_utm long varchar (1024), sd_earfcn_dl integer, sd_freq_band long varchar (1024), sd_freq_type long varchar (1024), sd_horizontal_beamwidth integer, sd_node_type long varchar (1024), sd_enodeb_id integer, sd_cellid integer, sd_cell_type long varchar (1024), sd_tal long varchar (1024), sd_tac integer, sd_pci integer, sd_frequency long varchar (1024), sd_mcc long varchar (1024), sd_mnc long varchar (1024), sd_antenna long varchar (1024), sd_e_tilt long varchar (1024), sd_m_tilt long varchar (1024), sd_ne long varchar (1024), sd_engineer long varchar (1024), sd_cell_coverage long varchar (1024), sd_siteatt long varchar (1024) ). java.lang.exception: error: s2vutils.getconnectiontoverticahost(): fatal error. cound not connection host in list:'list(127.0.0.1)'. 16/08/08 14:39:00 error s2vutils: createtemptables(): failed create table public.s2v_temp_table_testtable_s2v_job4115324674851267391 16/08/08 14:39:00 error s2vutils: createtemptables(): failed create table public.s2v_temp_table_testtable_s2v_job4115324674851267391_last_committer 16/08/08 14:39:01 error s2vutils: error: getconnectiontoverticahost(): connectexception: java.lang.nullpointerexception 16/08/08 14:39:01 error s2vutils: error: connectexception: java.lang.exception: error: s2vutils.getconnectiontoverticahost(): fatal error. cound not connection host in list:'list(127.0.0.1)'. 16/08/08 14:39:01 error s2vutils: createtemptables(): failed create table public.s2v_job_status 16/08/08 14:39:02 error s2vutils: createtemptables(): failed create tables public.s2v_temp_table_testtable_s2v_job4115324674851267391_commits_partition_0...1 16/08/08 14:39:02 error verticasparkconnectorloader: error in savetovertica java.lang.exception: error: s2v.save(): failed setup temp tables track spark partition commits. @ com.vertica.spark.s2v.s2v.save(s2v.scala:117) @ com.vertica.spark.datasource.defaultsource.createrelation(verticasource.scala:77) @ org.apache.spark.sql.execution.datasources.resolveddatasource$.apply(resolveddatasource.scala:222) @ org.apache.spark.sql.dataframewriter.save(dataframewriter.scala:148) @ my.java.file(myjavafile.java:54)
Comments
Post a Comment