Troubleshooting
Problem
RTM cacti log reports MySQL 1114 errors repeatedly against a memory table.
Symptom
In cacti log, the following messages are being populated, MySQL version is 5.1.x:
CMDPHP: Poller[0] ERROR: A DB Exec Failed!,
Error:'1114', SQL:"insert into poller_output (local_data_id, rrd_name,
time, output) values (54253, '', '2015-07-17 10:01:09', 'max_jobs:2
num_jobs:0 run_jobs:0 sys_susp_jobs:0 usr_susp_jobs:0 res_jobs:0')'
CMDPHP: Poller[0] ERROR: A DB Exec Failed!,
Error:'1114', SQL:"insert into poller_output (local_data_id, rrd_name,
time, output) values (54254, '', '2015-07-17 10:01:09', 'r15s:0 r1m:0
r15m:0')'
Cause
The error code 1114 is a MySQL- specific error. It means that a table is full. In above error messages, it means that table poller_output is full. The table poller_output is a memory table, all its content resides in memory.
The error message means the table size has reached the max size allowed for memory table.
Diagnosing The Problem
MySQL defines the variable max_heap_table_size, it sets the maximum size to which user-created MEMORY tables are permitted to grow.
Here is the query to check its value
mysql> SELECT @@max_heap_table_size;
+-----------------------+
| @@max_heap_table_size |
+-----------------------+
| 67108864 |
+-----------------------+
You can check the table size of a specific table, for example, poller_out
SELECT table_name, data_length + index_length as size FROM information_schema.TABLES WHERE table_schema = 'cacti' and table_name = 'poller_output';
If the returned size is equal to the max_heap_table_size, then you will see the table full error.
Resolving The Problem
In case of table poller_output, it should always be emptied after each polling cycle. So this error usually is related to cacti poller slow performance and please contact IBM support for further assistance.
For other memory tables, you can try to increase max_heap_table_size to a bigger value in /etc/my.cnf if you have sufficient memory on DB host. Restart MySQL daemon. It should work around the memory table 1114 error.
Note: Always shut down RTM services before restarting mysql and remember to start them up again later.
Was this topic helpful?
Document Information
Modified date:
23 June 2018
UID
isg3T1022528