Ywat / dataloadercliq

Automatically exported from code.google.com/p/dataloadercliq
0 stars 0 forks source link

Error in Data Loader for bulk data #87

Open GoogleCodeExporter opened 8 years ago

GoogleCodeExporter commented 8 years ago
Hi 

This is my process conf file, i have similar beans for 3 more objects in same 
process conf file. works fine if the data count is less, tested for 100 in each 
file. i am geting the error if i try to insert bulk ammount(25,000) of data to 
more than one object at same time in my windows system. 
01
<!DOCTYPE beans PUBLIC "-//SPRING//DTD BEAN//EN" 
"http://www.springframework.org/dtd/spring-beans.dtd">
02
<beans>
03
<bean id="insertprocessStatus" 
class="com.salesforce.dataloader.process.ProcessRunner" singleton="false">
04
        <description>Extract Staging Data.</description>
05
  <!--property name="ftpService" ref="ftpUpload"/-->
06
  <property name="name" value="insertprocessStatus"/>
07
         <property name="configOverrideMap">
08
              <map>
09
                <entry key="sfdc.debugMessages" value="false"/>
10
                  <entry key="sfdc.debugMessagesFile" value="../status/accountMasterSoapTrace.log"/>
11
                  <entry key="sfdc.endpoint" value="https://test.salesforce.com"/>
12
                  <entry key="sfdc.username" value="mayil@sfdc.com"/>
13
                  <entry key="sfdc.password"
14
value="066de8ada127a859f22236802ceab6cd36a20dcca57a11eacba26ec41ac9adb21de4eebc0
47ac11f"/>
15
                  <entry key="process.encryptionKeyFile" value="key.txt"/>
16
                  <entry key="sfdc.timeoutSecs" value="600"/>
17
                  <entry key="sfdc.loadBatchSize" value="200"/>
18
                  <entry key="sfdc.entity" value="DataImportprocess__c"/>
19
                  <entry key="process.operation" value="insert"/>
20
      <entry key="process.mappingFile" value="../map/DataImportprocessStatusmapper.sdl"/>
21
                  <entry key="process.outputError" value="../extras/errorDataImportprocessStatus.csv"/>
22
    <entry key="process.outputSuccess" value="../extras/successDataImportprocessStatus.csv"/>
23
    <entry key="dataAccess.name" value="../InputCSV/DataImportProcessStatus.csv" />
24
                  <entry key="dataAccess.type" value="csvRead"/>
25
                  <entry key="process.initialLastRunDate" value="2014-03-06T00:00:00.000-0800"/>
26
    <entry key="process.enableLastRunOutput" value="true" />
27
      <entry key="process.lastRunOutputDirectory" value="../conf/"/>
28
                   </map>
29
         </p<span style="background-color: rgb(255, 255, 255); font-family: Arial, Verdana, sans-serif; ">roperty>
30
</span><span style="background-color: rgb(255, 255, 255); font-family: Arial, 
Verdana, sans-serif; "></bean></span>

I am having individual bat files to call each bean, and master bat file to call 
all the individual bat files.
the filrst insert process getting completed successfully for any number of data 
(17k,20k r 25k), but the in second insert call gatiing the error as 

1
::In Master bat file
2
call <strong>InsertImportprocessStatus.bat</strong>
3
echo Inserting the CustomerCodeUsage records in Pre-Staging
4
call InsertList.bat
1
In InsertImportprocessStatus.bat file
2

3
java -cp ../lib/EnhencedDataloader.jar -Dsalesforce.config.dir="../conf" 
com.salesforce.dataloader.process.ProcessRunnerprocess.name=insertImportprocessS
tatus

My InsertImportprocessStatus.bat, insert all the data but getting the below 
error when calling InsertList.bat

ERROR [insertList] client.PartnerClient login (PartnerClient.java:1030) - Error 
while logging in to web service at: 
https://test.salesforce.com/services/Soap/u/19.0, error was: Failed to send 
request to https://test.salesforce.com/services/Soap/u/19.0
com.sforce.ws.ConnectionException: Failed to send request to 
https://test.salesforce.com/services/Soap/u/19.0
at com.sforce.ws.transport.SoapConnection.send(SoapConnection.java:113)
at com.sforce.soap.partner.PartnerConnection.login(PartnerConnection.java:998)
at com.salesforce.dataloader.client.PartnerClient.login(PartnerClient.java:1007)
at 
com.salesforce.dataloader.client.PartnerClient.connect(PartnerClient.java:105)
at com.salesforce.dataloader.controller.Controller.login(Controller.java:182)
at com.salesforce.dataloader.controller.Controller.login(Controller.java:177)
at com.salesforce.dataloader.process.ProcessRunner.run(ProcessRunner.java:130)
at com.salesforce.dataloader.process.ProcessRunner.main(ProcessRunner.java:258)
Caused by: java.net.UnknownHostException: test.salesforce.com
at java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.net.PlainSocketImpl.connect(Unknown Source)
at java.net.SocksSocketImpl.connect(Unknown Source)
at java.net.Socket.connect(Unknown Source)
at sun.security.ssl.SSLSocketImpl.connect(Unknown Source)
at sun.net.NetworkClient.doConnect(Unknown Source)
at sun.net.www.http.HttpClient.openServer(Unknown Source)
at sun.net.www.http.HttpClient.openServer(Unknown Source)
at sun.net.www.protocol.https.HttpsClient.<init>(Unknown Source)
at sun.net.www.protocol.https.HttpsClient.New(Unknown Source)
at 
sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.getNewHttpClient(U
nknown Source)
at sun.net.www.protocol.http.HttpURLConnection.plainConnect(Unknown Source)
at 
sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.connect(Unknown 
Source)
at sun.net.www.protocol.http.HttpURLConnection.getOutputStream(Unknown Source)
at sun.net.www.protocol.https.HttpsURLConnectionImpl.getOutputStream(Unknown 
Source)
at 
com.sforce.ws.transport.JdkHttpTransport.connectLocal(JdkHttpTransport.java:97)
at com.sforce.ws.transport.JdkHttpTransport.connect(JdkHttpTransport.java:82)
at com.sforce.ws.transport.SoapConnection.send(SoapConnection.java:99)
... 7 more
2014-05-23 16:27:40,890 FATAL [main] process.ProcessRunner topLevelError 
(ProcessRunner.java:239) - Unable to run process insertAccountList
java.lang.RuntimeException: com.sforce.ws.ConnectionException: Failed to send 
request to https://test.salesforce.com/services/Soap/u/19.0
at com.salesforce.dataloader.process.ProcessRunner.run(ProcessRunner.java:164)
at com.salesforce.dataloader.process.ProcessRunner.main(ProcessRunner.java:258)
Caused by: com.sforce.ws.ConnectionException: Failed to send request to 
https://test.salesforce.com/services/Soap/u/19.0
at com.sforce.ws.transport.SoapConnection.send(SoapConnection.java:113)
at com.sforce.soap.partner.PartnerConnection.login(PartnerConnection.java:998)
at com.salesforce.dataloader.client.PartnerClient.login(PartnerClient.java:1007)
at 
com.salesforce.dataloader.client.PartnerClient.connect(PartnerClient.java:105)
at com.salesforce.dataloader.controller.Controller.login(Controller.java:182)
at com.salesforce.dataloader.controller.Controller.login(Controller.java:177)
at com.salesforce.dataloader.process.ProcessRunner.run(ProcessRunner.java:130)
... 1 more
Caused by: java.net.UnknownHostException: test.salesforce.com
at java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.net.PlainSocketImpl.connect(Unknown Source)
at java.net.SocksSocketImpl.connect(Unknown Source)
at java.net.Socket.connect(Unknown Source)
at sun.security.ssl.SSLSocketImpl.connect(Unknown Source)
at sun.net.NetworkClient.doConnect(Unknown Source)
at sun.net.www.http.HttpClient.openServer(Unknown Source)
at sun.net.www.http.HttpClient.openServer(Unknown Source)
at sun.net.www.protocol.https.HttpsClient.<init>(Unknown Source)
at sun.net.www.protocol.https.HttpsClient.New(Unknown Source)
at 
sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.getNewHttpClient(U
nknown Source)
at sun.net.www.protocol.http.HttpURLConnection.plainConnect(Unknown Source)
at 
sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.connect(Unknown 
Source)
at sun.net.www.protocol.http.HttpURLConnection.getOutputStream(Unknown Source)
at sun.net.www.protocol.https.HttpsURLConnectionImpl.getOutputStream(Unknown 
Source)
at 
com.sforce.ws.transport.JdkHttpTransport.connectLocal(JdkHttpTransport.java:97)
at com.sforce.ws.transport.JdkHttpTransport.connect(JdkHttpTransport.java:82)
at com.sforce.ws.transport.SoapConnection.send(SoapConnection.java:99)
... 7 more

How to solve this issue

Original issue reported on code.google.com by komathip...@gmail.com on 26 May 2014 at 1:14