Re: ndbd process exits when disconnected - Mikael Ronström - com.mysql.lists.cluster

6 messages in com.mysql.lists.clusterRe: ndbd process exits when disconnected

From	Sent On	Attachments
Kenneth Lim	21 Sep 2004 12:41
Magnus Svensson	22 Sep 2004 05:33
Kenneth Lim	22 Sep 2004 09:21
Mikael Ronström	23 Sep 2004 00:35
Kenneth Lim	23 Sep 2004 09:39
Mikael Ronström	24 Sep 2004 00:19

Subject:	Re: ndbd process exits when disconnected
From:	Mikael Ronström (mik...@mysql.com)
Date:	09/24/2004 12:19:56 AM
List:	com.mysql.lists.cluster

Hi Kenneth,

If you reset the configuration parameter StopOnError (enabled by default), the ndbd process will restart automatically and try to contact the management server. After trying to contact it for 2 minutes it will fail again and make a new restart attempt for another 2 minutes and so forth. Within 5 seconds after you put the cable back into again the computer2 the ndbd starts properly again.

The only drawback with this is that within an hour or so of retries all entries in the error.log will say that it failed to contact the management server so log of older errrors will be gone.

Rgrds Mikael

2004-09-23 kl. 18.40 skrev Kenneth Lim:

Mikael -

You are correct in your assumption. Thanks for that explanation. So when computer2 is reconnected to the network, the ndbd process will have to be restarted manually right? There is no auto discovery process that says "I'm back. Let me back into the cluster."

-ken

-----Original Message----- From: Mikael Ronström [mailto:mik...@mysql.com] Sent: Thursday, September 23, 2004 12:36 AM To: Kenneth Lim Cc: Magnus Svensson; clus...@lists.mysql.com Subject: Re: ndbd process exits when disconnected

Hi Kenneth, If I understand correctly you have two computers and you are disconnecting the second computer from the network.

In this case you are disconnecting the node from the other computer where the other ndbd process was and the arbitrator. So the ndbd node on computer 2 is not able to be part of a majority of the cluster and then it decides to stop itself.

So this is a feature rather than a bug :)

Rgrds Mikael

2004-09-22 kl. 18.22 skrev Kenneth Lim:

Magnus -

Thanks for the quick response. Here is the part of ther error log:

Date/Time: Tuesday 21 September 2004 - 14:14:54 Type of error: error Message: Arbitrator shutdown Fault ID: 2305 Problem data: Arbitrator decided to shutdown this node Object of reference: QMGR (Line: 3774) 0x0000000a ProgramName: NDB Kernel ProcessID: 8169 TraceFile: ndb_2_trace.log.5 ***EOM***

Here is the first part of the trace log:

JAM CONTENTS up->down left->right ?=not block entry BLOCK ADDR ADDR ADDR ADDR ADDR ADDR ADDR ADDR ?006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006006 006018 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 002976 003322 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 002976 003322 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 002976 003322 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 002976 003322 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 002976 003322 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 002976 003322 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 002976 003322 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 002976 003322 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 002976 003322 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 002976 003322 DBACC 000107 000114 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 002976 003322 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 002976 003322 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 002976 003322 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 002976 003322 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 002976 003322 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 002976 003322 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 002976 003322 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 002976 003322 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 002976 003322 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 002976 003322 DBACC 000107 000114 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 002976 003322 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 001486 001496 QMGR 000088 000117 003300 003013 002976 003322 DBTC 005891 005925 005949 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 002976 003322 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 002976 003322 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 002976 003322 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 002976 003322 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 002976 003322 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 002976 003322 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 002976 003322 DBTUP 024480 024529 DBACC 000107 000114 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 002976 003322 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 002976 003322 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 002976 003322 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 002976 003322 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 002976 003322 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 002976 003322 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 002976 003322 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 002976 003322 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 QMGR 001919 001973 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 002976 003322 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 002976 003322 DBACC 000107 000114 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 002976 003322 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 002976 003322 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 002976 003322 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 002976 003322 DBTC 005891 005925 005949 DBLQH 002482 DBTC 003892 DBTUP 002032 NDBFS 000913 000915 000726 000932 QMGR 000088 000112 001449 001472 001486 QMGR 000088 000117 003300 003013 003710 003761 003763 003774

-----Original Message----- From: Magnus Svensson [mailto:msve...@mysql.com] Sent: Wednesday, September 22, 2004 5:34 AM To: Kenneth Lim Cc: clus...@lists.mysql.com Subject: Re: ndbd process exits when disconnected

Quoting Kenneth Lim <kl...@senvid.com>:

Hello -

I'm trying to get a simple MySQL Cluster up and running in a 2 computer configuration (computer1: mgm, db, api; computer2: db, api) running Red Hat Enterprise Linux 3.0. I am able to create a database and table. I have an external Connector/J JDBC program running on Windows inserting records into the table. All is fine up to this point. I can connect to either MySQL Server and see that the table contents are the same. When I disconnect computer2, I noticed that the "ndbd" processes go away on computer2. Has anyone seen this problem?

Thanks in advance for your help.

Hi,

When a ndbd node crashes it will produce an error log and a probably a trace file. Please enclose the error log file and the first part of the tracefile so that we can diagnose your problem.

The error log is called ndb_<nodeid>_error.log and the tracefiles are called ndb_<nodeid>_trace.log.<trace_file_no> and are normally written to the directory from where you started ndbd.

-ken

I am using the bundled binary distribution

mysql-max-4.1.4-gamma-pc-linux-i686.tar.gz

My config.ini is as follows:

[COMPUTER] Id: 1 HostName: db1

[COMPUTER] Id: 2 HostName: db2

[DB DEFAULT] NoOfReplicas: 2

[DB] Id: 1 ExecuteOnComputer: 1 FileSystemPath: /usr/local/mysql/data/mysql-cluster/node1

[DB] Id: 2 ExecuteOnComputer: 2 FileSystemPath: /usr/local/mysql/data/mysql-cluster/node2

[API] Id: 3 ExecuteOnComputer: 1

[API] Id: 4 ExecuteOnComputer: 2

[MGM] Id: 5 ExecuteOnComputer: 1 PortNumber: 2200