Forums » General Discussion

Thread: Data Comparison issue


Permlink Replies: 1 - Pages: 1 - Last Post: Mar 29, 2011 4:03 AM by: daebwae Threads: [ Previous | Next ]
daebwae

Posts: 2
Registered: 3/17/11
Data Comparison issue
Posted: Mar 17, 2011 4:52 AM
  Click to reply to this thread Reply

Dear all,


I love Toad for MySQL 5.0.0.345, but I'm experiencing issue which renders it unusable for my purposes.


My goal is to migrate data from one database to another. After the migration, I want to check the data with Toad's data comparison tool. 


The comparison works fine on most tables, but I have a few tables which are rather big; for example: article_plain has 127,000 entries. When I run a data compare on this table, I get the the error that the mysql connection was lost (for details see the end of this post). As I'm working on a test system, I was able to increase all mysql timeouts (wait, net_read_timeout etc.), max_package_size etc. to the highest values which MySQL allows. I tried to connect directly to the MySQL Server and I tunneled it via ssh (so that the connection appears to be coming from the localhost). Furthermore I'm getting a similar error on schema compare -> synchronize, when the data is inserted into the temporary table. However, if I run the synchronization script by hand, the error disappears and things work smoothly. So I suspected that I misconfigured the time outs in Toad. However, in the settings Database->Mysql, I set all relevant timeouts (execution, lock,idle) are set to '0'. This was also to no avail.

Now, I'm at a loss and would greatly appreciate your help!


Thanks in advance,

Stefan

 

Here's a copy from the error message:

17.03.2011 12:01:03; Info; Comparision started.
17.03.2011 12:01:19; Error; Table Reading error.
17.03.2011 12:01:19; Error; ----------------------------------------------- Exception -----------------------------------------------
17.03.2011 12:01:19; Error; Devart.Data.MySql.MySqlException
17.03.2011 12:01:19; Error; Lost connection to MySQL server during query
17.03.2011 12:01:19; Error; StackTrace :    at Devart.Common.aj.a(Exception A_0)
       at Devart.Data.MySql.bh.a(Exception A_0)
       at Devart.Common.t.e(Byte[] A_0, Int32 A_1, Int32 A_2)
       at Devart.Data.MySql.bk.a(Byte[] A_0, Int32 A_1, Int32 A_2)
       at Devart.Data.MySql.bk.a()
       at Devart.Data.MySql.bk.d()
       at Devart.Data.MySql.v.a(ah[]& A_0, Int32& A_1)
       at Devart.Data.MySql.v.a(Byte[] A_0, Int32 A_1, Boolean A_2)
       at Devart.Data.MySql.a2.e()
       at Devart.Data.MySql.a2.o()
       at Devart.Data.MySql.MySqlCommand.InternalExecute(CommandBehavior behavior, IDisposable stmt, Int32 startRecord, Int32 maxRecords)
       at Devart.Common.DbCommandBase.ExecuteDbDataReader(CommandBehavior behavior)
       at System.Data.Common.DbCommand.ExecuteReader()
       at Quest.DataCompare.PL.TADataDifference.OpenFirstQuery()
17.03.2011 12:01:19; Error; InnerException level 2 System.IO.IOException
17.03.2011 12:01:19; Error; Unable to read data from the transport connection: Ein Verbindungsversuch ist fehlgeschlagen, da die Gegenstelle nach einer bestimmten Zeitspanne nicht ordnungsgemäß reagiert hat, oder die hergestellte Verbindung war fehlerhaft, da der verbundene Host nicht reagiert hat.
17.03.2011 12:01:19; Error; InnerException StackTrace :    at System.Net.Sockets.NetworkStream.Read(Byte[] buffer, Int32 offset, Int32 size)
       at Devart.Common.a.b(Byte[] A_0, Int32 A_1, Int32 A_2)
       at Devart.Common.as.c(Byte[] A_0, Int32 A_1, Int32 A_2)
       at Devart.Common.t.e(Byte[] A_0, Int32 A_1, Int32 A_2)
17.03.2011 12:01:19; Error; InnerException level 3 System.Net.Sockets.SocketException
17.03.2011 12:01:19; Error; Ein Verbindungsversuch ist fehlgeschlagen, da die Gegenstelle nach einer bestimmten Zeitspanne nicht ordnungsgemäß reagiert hat, oder die hergestellte Verbindung war fehlerhaft, da der verbundene Host nicht reagiert hat
17.03.2011 12:01:19; Error; InnerException StackTrace :    at System.Net.Sockets.Socket.Receive(Byte[] buffer, Int32 offset, Int32 size, SocketFlags socketFlags)
       at System.Net.Sockets.NetworkStream.Read(Byte[] buffer, Int32 offset, Int32 size)
17.03.2011 12:01:19; Error; ---------------------------------------------------------------------------------------------------------
17.03.2011 12:01:19; Error; ----------------------------------------------- Exception -----------------------------------------------
17.03.2011 12:01:19; Error; Devart.Data.MySql.MySqlException
17.03.2011 12:01:19; Error; Lost connection to MySQL server during query
17.03.2011 12:01:19; Error; StackTrace :    at Quest.DataCompare.PL.TADataDifference.ReadData(TAObjectWithColumns iTableSource, TAObjectWithColumns iTableTarget, String sQuerySource, String sQueryTarget)
       at Quest.DataCompare.PL.TADataDifference.CompareData(DataToCompare ToCompare, ComparisionOptions ComparisionSettings, String FileCacheFolder, ICommandProgress progress, ConfirmRetryHandler retryHandler, EventHandler`1 dkRowAddedHandler, Boolean extractDataOnly)
       at Quest.DataCompare.PL.TAPairObjectWithColumns.DoCompare(CompareTypesOptions CompareOptions, ComparisionOptions ComparisionSettings, String FileCacheFolder, ICommandProgress progress, ConfirmRetryHandler retryHandler, EventHandler`1 dkRowAddedHandler, Boolean extractDataOnly)
       at Quest.DataCompare.PL.TAPLRoot.FillResults(Object sender, CompareTypesOptions cs, ComparisionOptions co, String FileCachePath, ArrayList ErrorList, ICommandProgress Progress, ConfirmRetryHandler confirmHandler, EventHandler`1 dkRowAddedHandler, Boolean extractDataOnly)
17.03.2011 12:01:19; Error; InnerException level 2 System.IO.IOException
17.03.2011 12:01:19; Error; Unable to read data from the transport connection: Ein Verbindungsversuch ist fehlgeschlagen, da die Gegenstelle nach einer bestimmten Zeitspanne nicht ordnungsgemäß reagiert hat, oder die hergestellte Verbindung war fehlerhaft, da der verbundene Host nicht reagiert hat.
17.03.2011 12:01:19; Error; InnerException StackTrace :    at System.Net.Sockets.NetworkStream.Read(Byte[] buffer, Int32 offset, Int32 size)
       at Devart.Common.a.b(Byte[] A_0, Int32 A_1, Int32 A_2)
       at Devart.Common.as.c(Byte[] A_0, Int32 A_1, Int32 A_2)
       at Devart.Common.t.e(Byte[] A_0, Int32 A_1, Int32 A_2)
17.03.2011 12:01:19; Error; InnerException level 3 System.Net.Sockets.SocketException
17.03.2011 12:01:19; Error; Ein Verbindungsversuch ist fehlgeschlagen, da die Gegenstelle nach einer bestimmten Zeitspanne nicht ordnungsgemäß reagiert hat, oder die hergestellte Verbindung war fehlerhaft, da der verbundene Host nicht reagiert hat
17.03.2011 12:01:19; Error; InnerException StackTrace :    at System.Net.Sockets.Socket.Receive(Byte[] buffer, Int32 offset, Int32 size, SocketFlags socketFlags)
       at System.Net.Sockets.NetworkStream.Read(Byte[] buffer, Int32 offset, Int32 size)
17.03.2011 12:01:19; Error; ---------------------------------------------------------------------------------------------------------
17.03.2011 12:01:19; Info; Comparision completed.
17.03.2011 12:01:19; Error; The Data Compare wizard failed to compare (1) pair of objects due to errors.
    The following displays a summary of the errors:
    Table [article_plain] (source) : Table [article_plain] (target)

 




daebwae

Posts: 2
Registered: 3/17/11
Re: Data Comparison issue
Posted: Mar 29, 2011 4:03 AM   in response to: daebwae
  Click to reply to this thread Reply

The issue persisted, so I downloaded verson 4.6 from the repisotory. With the exact same procedure and same data, the comparison worked fine. This seems to be a bug.

What did not work in Version 4, however, was to synchronize the data. An error occured there too. To test if the issue was with the server settings, I worte my own program to migrate the data. This worked out fine.

We have quite a few blob data in the DB, this might cause issues. But for now and until someone can explain to me, what I'm doing wrong or the bug is fixed, it's difficult to recommend Toad v5.



Legend
Guru: 2001 + pts
Expert: 751 - 2000 pts
Enthusiast: 31 - 750 pts
Novice: 0 - 30 pts
Moderators
Helpful answer (5 pts)
Answered (10 pts)

Point your RSS reader here for a feed of the latest messages in all forums