MySQLテーブルスペースが破損しているため、アサーションエラーでAIQUMにアクセスできません
環境
ActiveIQ Unified Manager(AIQUM)9.6以降
問題
- AIQUMにログインできません。エラー:
Sign In Failed. Please verify Username and Password.
- AIQUMへのアクセスによるHTTP
404 - Not Found
ocumserver.log
は、ポート3306へのConnection refused
を示しています。
ERROR [oncommand] [QuartzScheduler_unifiedManagerScheduler-NON_CLUSTERED_MisfireHandler] [o.s.s.q.LocalDataSourceJobStore] MisfireHandler: Error handling misfires: Failed to obtain DB connection from data source 'springNonTxDataSource.unifiedManagerScheduler': java.sql.SQLTransientConnectionException: um-default-data-source - Connection is not available, request timed out after 30000ms.
org.quartz.JobPersistenceException: Failed to obtain DB connection from data source 'springNonTxDataSource.unifiedManagerScheduler': java.sql.SQLTransientConnectionException: um-default-data-source - Connection is not available, request timed out after 30000ms.
at deployment.dfm-app.war//org.quartz.impl.jdbcjobstore.JobStoreCMT.getNonManagedTXConnection(JobStoreCMT.java:168)
at deployment.dfm-app.war//org.quartz.impl.jdbcjobstore.JobStoreSupport.doRecoverMisfires(JobStoreSupport.java:3246)
at deployment.dfm-app.war//org.quartz.impl.jdbcjobstore.JobStoreSupport$MisfireHandler.manage(JobStoreSupport.java:4012)
at deployment.dfm-app.war//org.quartz.impl.jdbcjobstore.JobStoreSupport$MisfireHandler.run(JobStoreSupport.java:4033)
Caused by: java.sql.SQLTransientConnectionException: um-default-data-source - Connection is not available, request timed out after 30000ms.
at deployment.dfm-app.war//com.zaxxer.hikari.pool.HikariPool.createTimeoutException(HikariPool.java:696)
at deployment.dfm-app.war//com.zaxxer.hikari.pool.HikariPool.getConnection(HikariPool.java:197)
at deployment.dfm-app.war//com.zaxxer.hikari.pool.HikariPool.getConnection(HikariPool.java:162)
at deployment.dfm-app.war//com.zaxxer.hikari.HikariDataSource.getConnection(HikariDataSource.java:100)
at deployment.dfm-app.war//com.netapp.dfm.persist.util.CompositeDataSource.getConnection(CompositeDataSource.java:97)
at deployment.dfm-app.war//com.netapp.dfm.persist.util.diag.ProfiledDataSource.getConnection(ProfiledDataSource.java:36)
at deployment.dfm-app.war//org.springframework.scheduling.quartz.LocalDataSourceJobStore$2.getConnection(LocalDataSourceJobStore.java:140)
at deployment.dfm-app.war//org.quartz.utils.DBConnectionManager.getConnection(DBConnectionManager.java:108)
at deployment.dfm-app.war//org.quartz.impl.jdbcjobstore.JobStoreCMT.getNonManagedTXConnection(JobStoreCMT.java:165)
... 3 common frames omitted
Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to address=(host=localhost)(port=3306)(type=master) : Socket fail to connect to host:localhost, port:3306. Connection refused (Connection refused)
at org.mariadb//org.mariadb.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:73)
server.log
のJBossにはConnection refused
ポート3306へのConnection refused も表示される
WARN [org.jboss.jca.core.connectionmanager.pool.strategy.OnePool] (pool-15-thread-1) IJ000604: Throwable while attempting to get a new connection: null: javax.resource.ResourceException: IJ031084: Unable to create connection
at org.jboss.ironjacamar.jdbcadapters@1.5.3.Final//org.jboss.jca.adapters.jdbc.local.LocalManagedConnectionFactory.createLocalManagedConnection(LocalManagedConnectionFactory.java:364)
at org.jboss.ironjacamar.jdbcadapters@1.5.3.Final//org.jboss.jca.adapters.jdbc.local.LocalManagedConnectionFactory.getLocalManagedConnection(LocalManagedConnectionFactory.java:371)
at org.jboss.ironjacamar.jdbcadapters@1.5.3.Final//org.jboss.jca.adapters.jdbc.local.LocalManagedConnectionFactory.createManagedConnection(LocalManagedConnectionFactory.java:287)
at org.jboss.ironjacamar.impl@1.5.3.Final//org.jboss.jca.core.connectionmanager.pool.mcp.SemaphoreConcurrentLinkedDequeManagedConnectionPool.createConnectionEventListener(SemaphoreConcurrentLinkedDequeManagedConnectionPool.java:1328)
at org.jboss.ironjacamar.impl@1.5.3.Final//org.jboss.jca.core.connectionmanager.pool.mcp.SemaphoreConcurrentLinkedDequeManagedConnectionPool.getConnection(SemaphoreConcurrentLinkedDequeManagedConnectionPool.java:505)
at org.jboss.ironjacamar.impl@1.5.3.Final//org.jboss.jca.core.connectionmanager.pool.AbstractPool.getSimpleConnection(AbstractPool.java:640)
at org.jboss.ironjacamar.impl@1.5.3.Final//org.jboss.jca.core.connectionmanager.pool.AbstractPool.getConnection(AbstractPool.java:605)
at org.jboss.ironjacamar.impl@1.5.3.Final//org.jboss.jca.core.connectionmanager.AbstractConnectionManager.getManagedConnection(AbstractConnectionManager.java:624)
at org.jboss.ironjacamar.impl@1.5.3.Final//org.jboss.jca.core.connectionmanager.tx.TxConnectionManagerImpl.getManagedConnection(TxConnectionManagerImpl.java:440)
at org.jboss.ironjacamar.impl@1.5.3.Final//org.jboss.jca.core.connectionmanager.AbstractConnectionManager.allocateConnection(AbstractConnectionManager.java:789)
at org.jboss.ironjacamar.jdbcadapters@1.5.3.Final//org.jboss.jca.adapters.jdbc.WrapperDataSource.getConnection(WrapperDataSource.java:151)
at org.jboss.as.connector@26.0.0.Final//org.jboss.as.connector.subsystems.datasources.WildFlyDataSource.getConnection(WildFlyDataSource.java:64)
at com.netapp.mega//com.netapp.oci.platform.common.table.ConnectionHelper$JndiConnectionHelper.doGetConnection(ConnectionHelper.java:353)
at com.netapp.mega//com.netapp.oci.platform.common.table.ConnectionHelper.getConnection(ConnectionHelper.java:230)
at com.netapp.mega//com.netapp.oci.platform.common.table.PrefixConnection.getConnection(PrefixConnection.java:42)
at com.netapp.mega//com.netapp.oci.platform.common.table.PrefixConnection.close(PrefixConnection.java:96)
at com.netapp.mega//com.netapp.oci.platform.common.table.ConnectionHelper.close(ConnectionHelper.java:294)
at deployment.mega-app.ear.server-core.jar//com.onaro.sanscreen.server.sessions.OriginatorUpdateSessionImpl.checkAndSend(OriginatorUpdateSessionImpl.java:443)
at deployment.mega-app.ear.server-core.jar//com.onaro.sanscreen.server.sessions.OriginatorUpdateSessionImpl.lambda$init$0(OriginatorUpdateSessionImpl.java:96)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [java.base:]
at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) [java.base:]
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) [java.base:]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [java.base:]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [java.base:]
at java.base/java.lang.Thread.run(Thread.java:829) [java.base:]
Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to address=(host=localhost)(port=3306)(type=master) : Socket fail to connect to host:localhost, port:3306. Connection refused (Connection refused)
at org.mariadb//org.mariadb.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:73) [mariadb-java-client.jar:]
at org.mariadb//org.mariadb.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:192) [mariadb-java-client.jar:]
at org.mariadb//org.mariadb.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1346) [mariadb-java-client.jar:]
at org.mariadb//org.mariadb.jdbc.internal.util.Utils.retrieveProxy(Utils.java:634) [mariadb-java-client.jar:]
at org.mariadb//org.mariadb.jdbc.MariaDbConnection.newConnection(MariaDbConnection.java:150) [mariadb-java-client.jar:]
at org.mariadb//org.mariadb.jdbc.Driver.connect(Driver.java:89) [mariadb-java-client.jar:]
at org.jboss.ironjacamar.jdbcadapters@1.5.3.Final//org.jboss.jca.adapters.jdbc.local.LocalManagedConnectionFactory.createLocalManagedConnection(LocalManagedConnectionFactory.java:335)
error.log
のMySQLは、MySQLサービスがAssertion failure
を検出したことを示しています。corruption in the InnoDB tablespace
[ERROR] [MY-013183] [InnoDB] Assertion failure: rec.cc:271 thread 140576495900416
InnoDB: We intentionally generate a memory trap.
InnoDB: Submit a detailed bug report to http://bugs.mysql.com.
InnoDB: If you get repeated assertion failures or crashes, even
InnoDB: immediately after the mysqld startup, there may be
InnoDB: corruption in the InnoDB tablespace. Please refer to
InnoDB: http://dev.mysql.com/doc/refman/8.0/en/forcing-innodb-recovery.html
InnoDB: about forcing recovery.