We are currently experiencing issues with dbremote running on remote databases. Replication has been running for months without issue but now we are getting the database locking up and dbremote failing to run. Dbremote seems to lose connection while processing files: I. 2013-11-11 17:43:29. UPDATE shipclip.NIIN SET FSC=NULL, COG=NULL, DESCR=NULL, UNIT_PRICE=224.08, BRF=NULL, UOM=NULL, AAC=NULL, SLC=NULL, SLAC=NULL, NET_PRICE=NULL VERIFY (FSC,COG,DESCR,UNIT_PRICE,BRF,UOM,AAC,SLC,SLAC,NET_PRICE) VALUES ('4820','9B','SEAT,VALVE',222.21,.25,'EA','Z','0','00',0) WHERE NIIN='012090384' |
We have pulled the remote database from the remote server and currently running the database on a stand-alone server with no other connections but the dbremote replication and still getting the same errors. The database stops and dbremote ends after 1 update statement. re: "the database stops" Does the database engine log have any entries from around the same time to indicate what might have happened? Did the database engine crash and generate a mini-dump file?
(12 Nov '13, 09:42)
Reg Domaratzki
|
No the subscribe by value is not being modified. No mini dump file. Tue Nov 12 2013 11:31:03 11:31:03 Attempting to connect using: UID=rep_dbo;PWD=*;DBN=SHIPCLIP;ServerName=SMISDBS12;LOG=C:smis_appShipCLIPLogsSHIPCLIP_agent_error.log 11:31:03 Attempting to connect to a running server... 11:31:03 Trying to start SharedMemory link ... 11:31:03 SharedMemory link started successfully 11:31:03 Attempting SharedMemory connection (no sasrv.ini cached address) 11:31:03 Connected to server over SharedMemory 11:31:03 Connected to SQL Anywhere Server version 12.0.1.3817 11:31:03 Application information: 11:31:03 IP=10.24.20.96;HOST=bth497286a;OSUSER=SYSTEM;OS='Windows 7 Build 7601 Service Pack 1';EXE='C:Program FilesSQL Anywhere 12Bin32dbremote.exe';PID=0x7100;THREAD=0xa14;VERSION=12.0.1.3817;API=DBLIB;TIMEZONEADJUSTMENT=-300 11:31:03 Connected to the server, attempting to connect to a running database... 11:31:03 [ 1] Connected to database successfully 11:31:03 Attempting to connect using: UID=rep_dbo;PWD=*;DBN=SHIPCLIP;ServerName=SMISDBS12;CON=get_remote_option;LOG=C:smis_appShipCLIPLogsSHIPCLIP_agent_error.log 11:31:03 Attempting to connect to a running server... 11:31:03 Attempting SharedMemory connection (no sasrv.ini cached address) 11:31:03 Connected to server over SharedMemory 11:31:03 Connected to SQL Anywhere Server version 12.0.1.3817 11:31:03 Application information: 11:31:03 IP=10.24.20.96;HOST=bth497286a;OSUSER=SYSTEM;OS='Windows 7 Build 7601 Service Pack 1';EXE='C:Program FilesSQL Anywhere 12Bin32dbremote.exe';PID=0x7100;THREAD=0xa14;VERSION=12.0.1.3817;API=DBLIB;TIMEZONEADJUSTMENT=-300 11:31:03 Connected to the server, attempting to connect to a running database... 11:31:03 [ 2] Connected to database successfully 11:31:03 Attempting to connect using: UID=rep_dbo;PWD=*;DBN=SHIPCLIP;ServerName=SMISDBS12;CON=Worker0;LOG=C:smis_appShipCLIPLogsSHIPCLIP_agent_error.log 11:31:03 Attempting to connect to a running server... 11:31:03 Attempting SharedMemory connection (no sasrv.ini cached address) 11:31:03 Connected to server over SharedMemory 11:31:03 Connected to SQL Anywhere Server version 12.0.1.3817 11:31:03 Application information: 11:31:03 IP=10.24.20.96;HOST=bth497286a;OSUSER=SYSTEM;OS='Windows 7 Build 7601 Service Pack 1';EXE='C:Program FilesSQL Anywhere 12Bin32dbremote.exe';PID=0x7100;THREAD=0xa14;VERSION=12.0.1.3817;API=DBLIB;TIMEZONEADJUSTMENT=-300 11:31:03 Connected to the server, attempting to connect to a running database... 11:31:03 [ 3] Connected to database successfully 11:31:03 Attempting to connect using: UID=rep_dbo;PWD=*;DBN=SHIPCLIP;ServerName=SMISDBS12;CON=SYNCH;LOG=C:smis_appShipCLIPLogsSHIPCLIP_agent_error.log 11:31:03 Attempting to connect to a running server... 11:31:03 Attempting SharedMemory connection (no sasrv.ini cached address) 11:31:03 Connected to server over SharedMemory 11:31:03 Connected to SQL Anywhere Server version 12.0.1.3817 11:31:03 Application information: 11:31:03 IP=10.24.20.96;HOST=bth497286a;OSUSER=SYSTEM;OS='Windows 7 Build 7601 Service Pack 1';EXE='C:Program FilesSQL Anywhere 12Bin32dbremote.exe';PID=0x7100;THREAD=0xa14;VERSION=12.0.1.3817;API=DBLIB;TIMEZONEADJUSTMENT=-300 11:31:03 Connected to the server, attempting to connect to a running database... 11:31:03 [ 4] Connected to database successfully 11:31:04 [ 3] Disconnecting shared memory client, process id not found 11:31:04 [ 3] Communication function i_cs_HandleSQLPresError code 4 11:31:04 [ 3] Communication function StrmGetInd code 7 11:31:04 Attempting to connect using: UID=rep_dbo;PWD=**;DBN=SHIPCLIP;ServerName=SMISDBS12;CON=ERROR;LOG=C:smis_appShipCLIPLogsSHIPCLIP_agent_error.log 11:31:04 Attempting to connect to a running server... 11:31:04 Attempting SharedMemory connection (no sasrv.ini cached address) 11:31:04 Failed to connect over SharedMemory 11:31:04 Cannot connect to server 11:31:04 [ 2] Disconnecting shared memory client, process id not found 11:31:04 [ 2] Communication function i_cs_HandleSQLPresError code 4 11:31:04 [ 2] Communication function StrmGetInd code 7 11:31:04 [ 4] Disconnecting shared memory client, process id not found 11:31:04 [ 4] Communication function i_cs_HandleSQLPresError code 4 11:31:04 [ 4] Communication function StrmGetInd code 7 11:31:05 [ 1] Disconnecting shared memory client, process id not found 11:31:05 [ 1] Communication function i_cs_HandleSQLPresError code 4 11:31:05 [ 1] Communication function StrmGetInd code 7 That's the log generated on the client side as a result of adding "log=" into the connection string. It tells us the database engine isn't running anymore. What about the database engine log? We need to figure out why the database engine shut down.
(12 Nov '13, 11:45)
Reg Domaratzki
|
There is nothing in the Server Log. It does not even show the database shutdown I. 11/12 10:45:55. Now accepting requests I. 11/12 10:45:55. Starting TCPIP listener on IP address (::):2641 I. 11/12 10:45:55. Starting TCPIP listener on IP address 0.0.0.0:2641 I. 11/12 10:52:30. Starting checkpoint of "shipclip" (shipclip.db) at Tue Nov 12 2013 10:52 I. 11/12 10:52:31. Finished checkpoint of "shipclip" (shipclip.db) at Tue Nov 12 2013 10:52 I. 11/12 10:59:11. Starting checkpoint of "shipclip" (shipclip.db) at Tue Nov 12 2013 10:59 I. 11/12 10:59:11. Finished checkpoint of "shipclip" (shipclip.db) at Tue Nov 12 2013 10:59 I. 11/12 11:05:52. Starting checkpoint of "shipclip" (shipclip.db) at Tue Nov 12 2013 11:05 I. 11/12 11:05:52. Finished checkpoint of "shipclip" (shipclip.db) at Tue Nov 12 2013 11:05 I. 11/12 11:12:32. Starting checkpoint of "shipclip" (shipclip.db) at Tue Nov 12 2013 11:12 I. 11/12 11:12:33. Finished checkpoint of "shipclip" (shipclip.db) at Tue Nov 12 2013 11:12 I. 11/12 11:19:13. Starting checkpoint of "shipclip" (shipclip.db) at Tue Nov 12 2013 11:19 I. 11/12 11:19:13. Finished checkpoint of "shipclip" (shipclip.db) at Tue Nov 12 2013 11:19 I. 11/12 11:25:54. Starting checkpoint of "shipclip" (shipclip.db) at Tue Nov 12 2013 11:25 I. 11/12 11:25:54. Finished checkpoint of "shipclip" (shipclip.db) at Tue Nov 12 2013 11:25 I. 11/12 11:31:03. Connection ID 1: "rep_dbo" connected to database "shipclip" from SQL Anywhere 12.0.1 (3817) client over SharedMemory I. 11/12 11:31:03. Connection ID 1: AppInfo is IP=10.24.20.96;HOST=bth497286a;OSUSER=SYSTEM;OS='Windows 7 Build 7601 Service Pack 1';EXE='C:Program FilesSQL Anywhere 12Bin32dbremote.exe';PID=0x7100;THREAD=0xa14;VERSION=12.0.1.3817;API=DBLIB;TIMEZONEADJUSTMENT=-300 I. 11/12 11:31:03. Connection ID 1: Server character set conversion is enabled, but not required using character set "windows-1252" I. 11/12 11:31:03. Connection ID 2: "rep_dbo" connected to database "shipclip" from SQL Anywhere 12.0.1 (3817) client over SharedMemory I. 11/12 11:31:03. Connection ID 2: AppInfo is IP=10.24.20.96;HOST=bth497286a;OSUSER=SYSTEM;OS='Windows 7 Build 7601 Service Pack 1';EXE='C:Program FilesSQL Anywhere 12Bin32dbremote.exe';PID=0x7100;THREAD=0xa14;VERSION=12.0.1.3817;API=DBLIB;TIMEZONEADJUSTMENT=-300 I. 11/12 11:31:03. Connection ID 2: Server character set conversion is enabled, but not required using character set "windows-1252" I. 11/12 11:31:03. Connection ID 3: "rep_dbo" connected to database "shipclip" from SQL Anywhere 12.0.1 (3817) client over SharedMemory I. 11/12 11:31:03. Connection ID 3: AppInfo is IP=10.24.20.96;HOST=bth497286a;OSUSER=SYSTEM;OS='Windows 7 Build 7601 Service Pack 1';EXE='C:Program FilesSQL Anywhere 12Bin32dbremote.exe';PID=0x7100;THREAD=0xa14;VERSION=12.0.1.3817;API=DBLIB;TIMEZONEADJUSTMENT=-300 I. 11/12 11:31:03. Connection ID 3: Server character set conversion is enabled, but not required using character set "windows-1252" I. 11/12 11:31:03. Connection ID 4: "rep_dbo" connected to database "shipclip" from SQL Anywhere 12.0.1 (3817) client over SharedMemory I. 11/12 11:31:03. Connection ID 4: AppInfo is IP=10.24.20.96;HOST=bth497286a;OSUSER=SYSTEM;OS='Windows 7 Build 7601 Service Pack 1';EXE='C:Program FilesSQL Anywhere 12Bin32dbremote.exe';PID=0x7100;THREAD=0xa14;VERSION=12.0.1.3817;API=DBLIB;TIMEZONEADJUSTMENT=-300 I. 11/12 11:31:03. Connection ID 4: Server character set conversion is enabled, but not required using character set "windows-1252" Are you sure no mini-dump files were generated? They would likely be at "%ALLUSERSPROFILE%SQL Anywhere 12diagnostics", although the page below gives more information about where the files might be located.
(12 Nov '13, 12:22)
Reg Domaratzki
|
VERSION=12.0.1.3817 FILENAME=C:\ProgramData\SQL Anywhere 12\diagnostics\SA12_20131112_113104_8228.crash_log OS=Windows 7 Build 7601 Service Pack 1 PROCESSOR=X86_64 EXEC_ARCH=X86 EXEC_PATH=C:\Program Files\SQL Anywhere 12\Bin32\dbsrv12.exe MODULE_PATH=C:\Program Files\SQL Anywhere 12\Bin32\dbserv12.dll EXCEPTION_PTR=08EBEC18 EXCEPTION_CODE=3221225477 EXCEPTION_FLAGS=0 EXCEPTION_RECORD=00000000 EXCEPTION_ADDRESS=00AE1F35 EXCEPTION_NumParameters=2 EXCEPTION_Param0=00000001 EXCEPTION_Param1=08ECF0FD TRYING_TO_SAVE_MINI_DUMP C:\ProgramData\SQL Anywhere 12\diagnostics\SA12_20131112_113104_8228.dmp DUMPLEVEL 0 SAVING_MINI_DUMP_COMPLETED CRASH_LOG_COMPLETE ATTEMPTING_TO_SUBMIT_MINIDUMP... This looks like a mini dump has been created. You might want to check for unsent crash reports in a command window with dbsupport -lc
(12 Nov '13, 12:53)
Reimer Pods
|
You may try to add the LOG=filename connection parameter to DBREMOTE's connection string to get debug information on connection issues.
You also might use sa_conn_info() and sa_locks() in a DBISQL session to try to find out whether the operations from SQL Remote are blocked by concurrent OLAP transactions...
If this is a blocking issue, have you set individual values for the BLOCKING and BLOCKING_TIMEOUT options, or are they used with their default values (ON and 0, meaning infinite waiting on blocks to be released)?
Does the database engine log have any entries from around the same time to indicate what might have happened?
Are you modifying the SUBSCRIBE BY values for an article when this happens?