Table of Contents
MyISAM Storage EngineInnoDB Storage EngineInnoDB OverviewInnoDB Contact InformationInnoDB ConfigurationInnoDB Startup OptionsInnoDB TablespaceInnoDB TablesInnoDB Data and Log FilesInnoDB DatabaseInnoDB Database to Another MachineInnoDB Transaction Model and LockingInnoDB Performance Tuning TipsInnoDB TablesInnoDB TroubleshootingMERGE Storage EngineMEMORY (HEAP) Storage EngineBDB (BerkeleyDB) Storage EngineEXAMPLE Storage EngineFEDERATED Storage EngineARCHIVE Storage EngineCSV Storage EngineBLACKHOLE Storage EngineMySQL supports several storage engines that act as handlers for different table types. MySQL storage engines include both those that handle transaction-safe tables and those that handle non-transaction-safe tables:
MyISAM manages non-transactional tables. It
provides high-speed storage and retrieval, as well as fulltext
searching capabilities. MyISAM is supported
in all MySQL configurations, and is the default storage engine
unless you have configured MySQL to use a different one by
default.
The MEMORY storage engine provides in-memory
tables. The MERGE storage engine allows a
collection of identical MyISAM tables to be
handled as a single table. Like MyISAM, the
MEMORY and MERGE storage
engines handle non-transactional tables, and both are also
included in MySQL by default.
Note: The
MEMORY storage engine was formerly known as
the HEAP engine.
The InnoDB and BDB storage
engines provide transaction-safe tables. BDB
is included in MySQL-Max binary distributions on those operating
systems that support it. InnoDB is also
included by default in all MySQL 5.0 binary
distributions. In source distributions, you can enable or
disable either engine by configuring MySQL as you like.
The EXAMPLE storage engine is a
“stub” engine that does nothing. You can create
tables with this engine, but no data can be stored in them or
retrieved from them. The purpose of this engine is to serve as
an example in the MySQL source code that illustrates how to
begin writing new storage engines. As such, it is primarily of
interest to developers.
NDB Cluster is the storage engine used by
MySQL Cluster to implement tables that are partitioned over many
computers. It is available in MySQL-Max 5.0 binary
distributions. This storage engine is currently supported on
Linux, Solaris, and Mac OS X only. We intend to add support for
this engine on other platforms, including Windows, in future
MySQL releases.
The ARCHIVE storage engine is used for
storing large amounts of data without indexes with a very small
footprint.
The CSV storage engine stores data in text
files using comma-separated-values format.
The BLACKHOLE storage engine accepts but does
not store data and retrievals always return an empty set.
The FEDERATED storage engine was added in
MySQL 5.0.3. This engine stores data in a remote database. In
this release, it works with MySQL only, using the MySQL C Client
API. In future releases, we intend to enable it to connect to
other data sources using other drivers or client connection
methods.
This chapter describes each of the MySQL storage engines except for
NDB Cluster, which is covered in
Chapter 15, MySQL Cluster.
When you create a new table, you can tell MySQL what type of table
to create by adding an ENGINE or
TYPE table option to the CREATE
TABLE statement:
CREATE TABLE t (i INT) ENGINE = INNODB; CREATE TABLE t (i INT) TYPE = MEMORY;
While TYPE is still supported in MySQL
5.0, ENGINE is now the preferred
term.
If you omit the ENGINE or TYPE
option, the default storage engine is used. Normally this is
MyISAM, but you can change it by using the
--default-storage-engine or
--default-table-type server startup option, or by
setting the storage_engine or
table_type system variable.
When MySQL is installed on Windows using the MySQL Configuration
Wizard, the InnoDB storage engine is the default
instead of MyISAM. See
Section 2.3.5.1, “Introduction”.
To convert a table from one type to another, use an ALTER
TABLE statement that indicates the new type:
ALTER TABLE t ENGINE = MYISAM; ALTER TABLE t TYPE = BDB;
See Section 13.1.5, “CREATE TABLE Syntax” and
Section 13.1.2, “ALTER TABLE Syntax”.
If you try to use a storage engine that is not compiled in or that
is compiled in but deactivated, MySQL instead creates a table of
type MyISAM. This behavior is convenient when you
want to copy tables between MySQL servers that support different
storage engines. (For example, in a replication setup, perhaps your
master server supports transactional storage engines for increased
safety, but the slave servers use only non-transactional storage
engines for greater speed.)
This automatic substitution of the MyISAM table
type when an unavailable type is specified can be confusing for new
MySQL users. A warning is generated whenever a table type is
automatically changed.
MySQL always creates an .frm file to hold the
table and column definitions. The table's index and data may be
stored in one or more other files, depending on the table type. The
server creates the .frm file above the storage
engine level. Individual storage engines create any additional files
required for the tables that they manage.
A database may contain tables of different types.
Transaction-safe tables (TSTs) have several advantages over non-transaction-safe tables (NTSTs):
They are safer. Even if MySQL crashes or you get hardware problems, you can get your data back, either by automatic recovery or from a backup plus the transaction log.
You can combine many statements and accept them all at the same
time with the COMMIT statement (if autocommit
is disabled).
You can execute ROLLBACK to ignore your
changes (if autocommit is disabled).
If an update fails, all of your changes are reverted. (With non-transaction-safe tables, all changes that have taken place are permanent.)
Transaction-safe storage engines can provide better concurrency for tables that get many updates concurrently with reads.
Although MySQL supports several transaction-safe storage engines,
for best results, you should not mix different table types within a
transaction. For information about the problems that can occur if
you do this, see Section 13.4.1, “START TRANSACTION, COMMIT, and ROLLBACK Syntax”.
InnoDB uses default configuration values if you
specify none. See Section 14.2.3, “InnoDB Configuration”.
Non-transaction-safe tables have several advantages of their own, all of which occur because there is no transaction overhead:
Much faster
Lower disk space requirements
Less memory required to perform updates
You can combine transaction-safe and non-transaction-safe tables in the same statements to get the best of both worlds. However, within a transaction with autocommit disabled, changes to non-transaction-safe tables still are committed immediately and cannot be rolled back.
MyISAM is the default storage engine. It is
based on the older ISAM code but has many
useful extensions. (Note that MySQL 5.0 does
not support ISAM.)
Each MyISAM table is stored on disk in three
files. The files have names that begin with the table name and
have an extension to indicate the file type. An
.frm file stores the table definition. The
data file has an .MYD
(MYData) extension. The index file has an
.MYI (MYIndex) extension.
To specify explicitly that you want a MyISAM
table, indicate that with an ENGINE table
option:
CREATE TABLE t (i INT) ENGINE = MYISAM;
(Note: Older versions of MySQL
used TYPE rather than ENGINE
(for example: TYPE = MYISAM). MySQL
5.0 supports this syntax for backwards compatibility
but TYPE is now deprecated and
ENGINE is the preferred usage.)
Normally, the ENGINE option is unnecessary;
MyISAM is the default storage engine unless the
default has been changed.
You can check or repair MyISAM tables with the
myisamchk utility. See
Section 5.9.5.6, “Using myisamchk for Crash Recovery”. You can also compress
MyISAM tables with
myisampack to take up much less space. See
Section 8.2, “myisampack — Generate Compressed, Read-Only MyISAM Tables”.
The following are some characteristics of the
MyISAM storage engine:
All data values are stored with the low byte first. This makes the data machine and operating system independent. The only requirement for binary portability is that the machine uses two's-complement signed integers (as every machine for the last 20 years has) and IEEE floating-point format (also totally dominant among mainstream machines). The only area of machines that may not support binary compatibility are embedded systems, which sometimes have peculiar processors.
There is no big speed penalty for storing data low byte first; the bytes in a table row normally are unaligned and it doesn't take that much more power to read an unaligned byte in order than in reverse order. Also, the code in the server that fetches column values is not time critical compared to other code.
Large files (up to 63-bit file length) are supported on filesystems and operating systems that support large files.
Dynamic-sized rows are much less fragmented when mixing deletes with updates and inserts. This is done by automatically combining adjacent deleted blocks and by extending blocks if the next block is deleted.
The maximum number of indexes per MyISAM
table is 64. This can be changed by recompiling. The maximum
number of columns per index is 16.
The maximum key length is 1000 bytes. This can also be changed by recompiling. For the case of a key longer than 250 bytes, a larger key block size than the default of 1024 bytes is used.
BLOB and TEXT columns
can be indexed.
NULL values are allowed in indexed columns.
This takes 0-1 bytes per key.
All numeric key values are stored with the high byte first to allow better index compression.
When records are inserted in sorted order (as when you are
using an AUTO_INCREMENT column), the index
tree is split so that the high node only contains one key.
This improves space utilization in the index tree.
Internal handling of one AUTO_INCREMENT
column per table. MyISAM automatically
updates this column for INSERTand
UPDATE operations. This makes
AUTO_INCREMENT columns faster (at least
10%). Values at the top of the sequence are not reused after
being deleted. (When an AUTO_INCREMENT
column is defined as the last column of a multiple-column
index, reuse of values deleted from the top of a sequence does
occur.) The AUTO_INCREMENT value can be
reset with ALTER TABLE or
myisamchk.
If a table has no free blocks in the middle of the data file,
you can INSERT new rows into it at the same
time that other threads are reading from the table. (These are
known as concurrent inserts.) A free block can occur as a
result of deleting rows or an update of a dynamic length row
with more data than its current contents. When all free blocks
are used up (filled in), future inserts become concurrent
again.
You can put the data file and index file on different
directories to get more speed with the DATA
DIRECTORY and INDEX DIRECTORY
table options to CREATE TABLE. See
Section 13.1.5, “CREATE TABLE Syntax”.
Each character column can have a different character set. See Chapter 10, Character Set Support.
There is a flag in the MyISAM index file
that indicates whether the table was closed correctly. If
mysqld is started with the
--myisam-recover option,
MyISAM tables are automatically checked
when opened, and are repaired if the table wasn't closed
properly.
myisamchk marks tables as checked if you
run it with the --update-state option.
myisamchk --fast checks only those tables
that don't have this mark.
myisamchk --analyze stores statistics for portions of keys, as well as for entire keys.
myisampack can pack BLOB
and VARCHAR columns.
MyISAM also supports the following features:
Support for a true VARCHAR type; a
VARCHAR column starts with a length stored
in two bytes.
Tables with VARCHAR may have fixed or
dynamic record length.
VARCHAR and CHAR columns
may be up to 64KB.
A hashed computed index can be used for
UNIQUE. This allows you to have
UNIQUE on any combination of columns in a
table. (However, you cannot search on a
UNIQUE computed index.)
Additional resources
For the MyISAM storage engine, there's a
dedicated forum available on
http://forums.mysql.com/list.php?21.
The following options to mysqld can be used
to change the behavior of MyISAM tables:
--myisam-recover=
mode
Set the mode for automatic recovery of crashed
MyISAM tables.
--delay-key-write=ALL
Don't flush key buffers between writes for any
MyISAM table.
Note: If you do this, you
should not use MyISAM tables from another
program (such as from another MySQL server or with
myisamchk) when the table is in use.
Doing so leads to index corruption.
Using --external-locking does not help for
tables that use --delay-key-write.
See Section 5.3.1, “mysqld Command-Line Options”.
The following system variables affect the behavior of
MyISAM tables:
bulk_insert_buffer_size
The size of the tree cache used in bulk insert optimization. Note: This is a limit per thread!
myisam_max_extra_sort_file_size
Used to help MySQL to decide when to use the slow but safe key cache index creation method. Note: This parameter was given in bytes before MySQL 5.0.6, when it was removed.
myisam_max_sort_file_size
Don't use the fast sort index method to create an index if the temporary file would become larger than this. Note: This parameter is given in bytes.
myisam_sort_buffer_size
Set the size of the buffer used when recovering tables.
See Section 5.3.3, “Server System Variables”.
Automatic recovery is activated if you start
mysqld with the
--myisam-recover option. In this case, when the
server opens a MyISAM table, it checks
whether the table is marked as crashed or whether the open count
variable for the table is not 0 and you are running the server
with --skip-external-locking. If either of
these conditions is true, the following happens:
The table is checked for errors.
If the server finds an error, it tries to do a fast table repair (with sorting and without re-creating the data file).
If the repair fails because of an error in the data file (for example, a duplicate-key error), the server tries again, this time re-creating the data file.
If the repair still fails, the server tries once more with the old repair option method (write row by row without sorting). This method should be able to repair any type of error and has low disk space requirements.
If the recovery wouldn't be able to recover all rows from a
previous completed statement and you didn't specify
FORCE in the value of the
--myisam-recover option, automatic repair
aborts with an error message in the error log:
Error: Couldn't repair table: test.g00pages
If you specify FORCE, a warning like this is
written instead:
Warning: Found 344 of 354 rows when repairing ./test/g00pages
Note that if the automatic recovery value includes
BACKUP, the recovery process creates files
with names of the form
.
You should have a cron script that
automatically moves these files from the database directories to
backup media.
tbl_name-datetime.BAK
MyISAM tables use B-tree indexes. You can
roughly calculate the size for the index file as
(key_length+4)/0.67, summed over all keys.
This is for the worst case when all keys are inserted in sorted
order and the table doesn't have any compressed keys.
String indexes are space compressed. If the first index part is
a string, it is also prefix compressed. Space compression makes
the index file smaller than the worst-case figure if the string
column has a lot of trailing space or is a
VARCHAR column that is not always used to the
full length. Prefix compression is used on keys that start with
a string. Prefix compression helps if there are many strings
with an identical prefix.
In MyISAM tables, you can also prefix
compress numbers by specifying PACK_KEYS=1
when you create the table. This helps when you have many integer
keys that have an identical prefix when the numbers are stored
high-byte first.
MyISAM supports three different storage
formats. Two of them (fixed and dynamic format) are chosen
automatically depending on the type of columns you are using.
The third, compressed format, can be created only with the
myisampack utility.
When you CREATE or ALTER a
table that has no BLOB or
TEXT columns, you can force the table format
to FIXED or DYNAMIC with
the ROW_FORMAT table option. This causes
CHAR and VARCHAR columns
to become CHAR for FIXED
format, or VARCHAR for
DYNAMIC format.
You can compress or decompress tables by specifying
ROW_FORMAT={COMPRESSED | DEFAULT} with
ALTER TABLE. See
Section 13.1.5, “CREATE TABLE Syntax”.
Static format is the default for MyISAM
tables. It is used when the table contains no variable-length
columns (VARCHAR, BLOB,
or TEXT). Each row is stored using a fixed
number of bytes.
Of the three MyISAM storage formats, static
format is the simplest and most secure (least subject to
corruption). It is also the fastest of the on-disk formats.
The speed comes from the easy way that rows in the data file
can be found on disk: When looking up a row based on a row
number in the index, multiply the row number by the row
length. Also, when scanning a table, it is very easy to read a
constant number of records with each disk read operation.
The security is evidenced if your computer crashes while the
MySQL server is writing to a fixed-format
MyISAM file. In this case,
myisamchk can easily determine where each
row starts and ends, so it can usually reclaim all records
except the partially written one. Note that
MyISAM table indexes can always be
reconstructed based on the data rows.
General characteristics of static format tables:
CHAR columns are space-padded to the
column width. This is also true for
NUMERIC, and DECIMAL
columns created before MySQL 5.0.3.
Very quick.
Easy to cache.
Easy to reconstruct after a crash, because records are located in fixed positions.
Reorganization is unnecessary unless you delete a huge
number of records and want to return free disk space to
the operating system. To do this, use OPTIMIZE
TABLE or myisamchk -r.
Usually require more disk space than for dynamic-format tables.
Dynamic storage format is used if a MyISAM
table contains any variable-length columns
(VARCHAR, BLOB, or
TEXT), or if the table was created with the
ROW_FORMAT=DYNAMIC option.
This format is a little more complex because each row has a header that indicates how long it is. One record can also end up at more than one location when it is made longer as a result of an update.
You can use OPTIMIZE TABLE or
myisamchk to defragment a table. If you
have fixed-length columns that you access or change frequently
in a table that also contains some variable-length columns, it
might be a good idea to move the variable-length columns to
other tables just to avoid fragmentation.
General characteristics of dynamic-format tables:
All string columns are dynamic except those with a length less than four.
Each record is preceded by a bitmap that indicates which
columns contain the empty string (for string columns) or
zero (for numeric columns). Note that this does not
include columns that contain NULL
values. If a string column has a length of zero after
trailing space removal, or a numeric column has a value of
zero, it is marked in the bitmap and not saved to disk.
Non-empty strings are saved as a length byte plus the
string contents.
Much less disk space usually is required than for fixed-length tables.
Each record uses only as much space as is required.
However, if a record becomes larger, it is split into as
many pieces as are required, resulting in record
fragmentation. For example, if you update a row with
information that extends the row length, the row becomes
fragmented. In this case, you may have to run
OPTIMIZE TABLE or myisamchk
-r from time to time to improve performance. Use
myisamchk -ei to obtain table
statistics.
More difficult than static-format tables to reconstruct after a crash, because a record may be fragmented into many pieces and a link (fragment) may be missing.
The expected row length for dynamic-sized records is calculated using the following expression:
3 + (number of columns+ 7) / 8 + (number of char columns) + (packed size of numeric columns) + (length of strings) + (number of NULL columns+ 7) / 8
There is a penalty of 6 bytes for each link. A dynamic record is linked whenever an update causes an enlargement of the record. Each new link is at least 20 bytes, so the next enlargement probably goes in the same link. If not, another link is created. You can find the number of links using myisamchk -ed. All links may be removed with myisamchk -r.
Compressed storage format is a read-only format that is generated with the myisampack tool.
All MySQL distributions include myisampack by default. Compressed tables can be uncompressed with myisamchk.
Compressed tables have the following characteristics:
Compressed tables take very little disk space. This minimizes disk usage, which is helpful when using slow disks (such as CD-ROMs).
Each record is compressed separately, so there is very little access overhead. The header for a record takes up 1 to 3 bytes depending on the biggest record in the table. Each column is compressed differently. There is usually a different Huffman tree for each column. Some of the compression types are:
Suffix space compression.
Prefix space compression.
Numbers with a value of zero are stored using one bit.
If values in an integer column have a small range, the
column is stored using the smallest possible type. For
example, a BIGINT column (eight
bytes) can be stored as a TINYINT
column (one byte) if all its values are in the range
from -128 to
127.
If a column has only a small set of possible values,
the column type is converted to
ENUM.
A column may use any combination of the preceding compression types.
Can handle fixed-length or dynamic-length records.
The file format that MySQL uses to store data has been extensively tested, but there are always circumstances that may cause database tables to become corrupted.
Even though the MyISAM table format is very
reliable (all changes to a table made by an SQL statement are
written before the statement returns), you can still get
corrupted tables if any of the following events occur:
The mysqld process is killed in the middle of a write.
Unexpected computer shutdown occurs (for example, the computer is turned off).
Hardware failures.
You are using an external program (such as myisamchk) on a table that is being modified by the server at the same time.
A software bug in the MySQL or MyISAM
code.
Typical symptoms of a corrupt table are:
You get the following error while selecting data from the table:
Incorrect key file for table: '...'. Try to repair it
Queries don't find rows in the table or return incomplete data.
You can check the health of a MyISAM table
using the CHECK TABLE statement, and repair
a corrupted MyISAM table with
REPAIR TABLE. When
mysqld is not running, you can also check
or repair a table with the myisamchk
command. See Section 13.5.2.3, “CHECK TABLE Syntax”,
Section 13.5.2.6, “REPAIR TABLE Syntax”, and
Section 5.9.5, “myisamchk — MyISAM Table-Maintenance Utility”.
If your tables become corrupted frequently, you should try to
determine why this is happening. The most important thing to
know is whether the table became corrupted as a result of a
server crash. You can verify this easily by looking for a
recent restarted mysqld message in the
error log. If there is such a message, it is likely that table
corruption is a result of the server dying. Otherwise,
corruption may have occurred during normal operation. This is
a bug. You should try to create a reproducible test case that
demonstrates the problem. See Section A.4.2, “What to Do If MySQL Keeps Crashing” and
Section E.1.6, “Making a Test Case If You Experience Table Corruption”.
Each MyISAM index
(.MYI) file has a counter in the header
that can be used to check whether a table has been closed
properly. If you get the following warning from CHECK
TABLE or myisamchk, it means that
this counter has gone out of sync:
clients are using or haven't closed the table properly
This warning doesn't necessarily mean that the table is corrupted, but you should at least check the table.
The counter works as follows:
The first time a table is updated in MySQL, a counter in the header of the index files is incremented.
The counter is not changed during further updates.
When the last instance of a table is closed (because of a
FLUSH TABLES operation or because there
isn't room in the table cache), the counter is decremented
if the table has been updated at any point.
When you repair the table or check the table and it is found to be okay, the counter is reset to zero.
To avoid problems with interaction with other processes that might check the table, the counter is not decremented on close if it was zero.
In other words, the counter can go out of sync only under these conditions:
The MyISAM tables are copied without
first issuing LOCK TABLES and
FLUSH TABLES.
MySQL has crashed between an update and the final close. (Note that the table may still be okay, because MySQL always issues writes for everything between each statement.)
A table was modified by myisamchk --recover or myisamchk --update-state at the same time that it was in use by mysqld.
Multiple mysqld servers are using the
table and one server performed a REPAIR
TABLE or CHECK TABLE on the
table while it was in use by another server. In this
setup, it is safe to use CHECK TABLE,
although you might get the warning from other servers.
However, REPAIR TABLE should be avoided
because when one server replaces the data file with a new
one, this is not signaled to the other servers.
In general, it is a bad idea to share a data directory among multiple servers. See Section 5.12, “Running Multiple MySQL Servers on the Same Machine” for additional discussion.
InnoDB OverviewInnoDB Contact InformationInnoDB ConfigurationInnoDB Startup OptionsInnoDB TablespaceInnoDB TablesInnoDB Data and Log FilesInnoDB DatabaseInnoDB Database to Another MachineInnoDB Transaction Model and LockingInnoDB Performance Tuning TipsInnoDB TablesInnoDB Troubleshooting
InnoDB provides MySQL with a transaction-safe
(ACID compliant) storage engine with commit,
rollback, and crash recovery capabilities.
InnoDB does locking on the row level and also
provides an Oracle-style consistent non-locking read in
SELECT statements. These features increase
multi-user concurrency and performance. There is no need for lock
escalation in InnoDB because row-level locks in
InnoDB fit in very little space.
InnoDB also supports FOREIGN
KEY constraints. In SQL queries you can freely mix
InnoDB type tables with other table types of
MySQL, even within the same query.
InnoDB has been designed for maximum
performance when processing large data volumes. Its CPU efficiency
is probably not matched by any other disk-based relational
database engine.
Fully integrated with MySQL Server, the InnoDB
storage engine maintains its own buffer pool for caching data and
indexes in main memory. InnoDB stores its
tables and indexes in a tablespace, which may consist of several
files (or raw disk partitions). This is different from, for
example, MyISAM tables where each table is
stored using separate files. InnoDB tables can
be of any size even on operating systems where file size is
limited to 2GB.
InnoDB is included in binary distributions by
default. The Windows Essentials installer makes
InnoDB the MySQL default table type on Windows.
InnoDB is used in production at numerous large
database sites requiring high performance. The famous Internet
news site Slashdot.org runs on InnoDB. Mytrix,
Inc. stores over 1TB of data in InnoDB, and
another site handles an average load of 800 inserts/updates per
second in InnoDB.
InnoDB is published under the same GNU GPL
License Version 2 (of June 1991) as MySQL. For more information on
MySQL licensing, see
http://www.mysql.com/company/legal/licensing/.
Additional resources
For the InnoDB storage engine, there's a
dedicated forum available on
http://forums.mysql.com/list.php?22.
Contact information for Innobase Oy, producer of the
InnoDB engine:
Web site: http://www.innodb.com/
Email: <sales@innodb.com>
Phone: +358-9-6969 3250 (office)
+358-40-5617367 (mobile)
Innobase Oy Inc.
World Trade Center Helsinki
Aleksanterinkatu 17
P.O.Box 800
00101 Helsinki
Finland
The InnoDB storage engine is enabled by
default. If you don't want to use InnoDB
tables, you can add the skip-innodb option to
your MySQL option file.
Two important disk-based resources managed by the
InnoDB storage engine are its tablespace data
files and its log files.
If you specify no InnoDB configuration options,
MySQL creates an auto-extending 10MB data file named
ibdata1 and two 5MB log files named
ib_logfile0 and
ib_logfile1 in the MySQL data directory.
Note: InnoDB
provides MySQL with a transaction-safe (ACID
compliant) storage engine with commit, rollback, and crash
recovery capabilities. It cannot do
so if the underlying operating system and hardware does
not work as advertised. Many operating systems or disk subsystems
may delay or reorder write operations in order to improve
performance. On some operating systems, the very system call
(fsync()) that should wait until all unwritten
data for a file has been flushed may actually return before the
data has been flushed to stable storage. Because of this, an
operating system crash or a power outage may destroy recently
committed data, or in the worst case, even corrupt the database
because of write operations having been reordered. If data
integrity is important to you, you should perform some
“pull-the-plug” tests before using anything in
production. On Mac OS X 10.3 and later, InnoDB uses a special
fcntl() file flush method. Under Linux, it is
advisable to disable the write-back
cache.
On ATAPI hard disks, a command like hdparm -W0
/dev/ may work.
Beware that some drives or disk controllers
may be unable to disable the write-back cache.
hda
Note: To get good performance,
you should explicitly provide InnoDB parameters
as discussed in the following examples. Naturally, you should edit
the settings to suit your hardware and requirements.
To set up the InnoDB tablespace files, use the
innodb_data_file_path option in the
[mysqld] section of the
my.cnf option file. On Windows, you can use
my.ini instead. The value of
innodb_data_file_path should be a list of one
or more data file specifications. If you name more than one data
file, separate them by semicolon
(‘;’) characters:
innodb_data_file_path=datafile_spec1[;datafile_spec2]...
For example, a setting that explicitly creates a tablespace having the same characteristics as the default is as follows:
[mysqld] innodb_data_file_path=ibdata1:10M:autoextend
This setting configures a single 10MB data file named
ibdata1 that is auto-extending. No location
for the file is given, so the default is the MySQL data directory.
Sizes are specified using M or
G suffix letters to indicate units of MB or GB.
A tablespace containing a fixed-size 50MB data file named
ibdata1 and a 50MB auto-extending file named
ibdata2 in the data directory can be
configured like this:
[mysqld] innodb_data_file_path=ibdata1:50M;ibdata2:50M:autoextend
The full syntax for a data file specification includes the filename, its size, and several optional attributes:
file_name:file_size[:autoextend[:max:max_file_size]]
The autoextend attribute and those following
can be used only for the last data file in the
innodb_data_file_path line.
If you specify the autoextend option for the
last data file, InnoDB extends the data file if
it runs out of free space in the tablespace. The increment is 8MB
at a time.
If the disk becomes full, you might want to add another data file
on another disk. Instructions for reconfiguring an existing
tablespace are given in Section 14.2.7, “Adding and Removing InnoDB Data and Log Files”.
InnoDB is not aware of the maximum file size,
so be cautious on filesystems where the maximum file size is 2GB.
To specify a maximum size for an auto-extending data file, use the
max attribute. The following configuration
allows ibdata1 to grow up to a limit of
500MB:
[mysqld] innodb_data_file_path=ibdata1:10M:autoextend:max:500M
InnoDB creates tablespace files in the MySQL
data directory by default. To specify a location explicitly, use
the innodb_data_home_dir option. For example,
to use two files named ibdata1 and
ibdata2 but create them in the
/ibdata directory, configure
InnoDB like this:
[mysqld] innodb_data_home_dir = /ibdata innodb_data_file_path=ibdata1:50M;ibdata2:50M:autoextend
Note: InnoDB
does not create directories, so make sure that the
/ibdata directory exists before you start the
server. This is also true of any log file directories that you
configure. Use the Unix or DOS mkdir command to
create any necessary directories.
InnoDB forms the directory path for each data
file by textually concatenating the value of
innodb_data_home_dir to the data file name,
adding a slash or backslash between if needed. If the
innodb_data_home_dir option is not mentioned in
my.cnf at all, the default value is the
“dot” directory ./, which means
the MySQL data directory.
If you specify innodb_data_home_dir as an empty
string, you can specify absolute paths for the data files listed
in the innodb_data_file_path value. The
following example is equivalent to the preceding one:
[mysqld] innodb_data_home_dir = innodb_data_file_path=/ibdata/ibdata1:50M;/ibdata/ibdata2:50M:autoextend
A simple my.cnf
example. Suppose that you have a computer with 128MB
RAM and one hard disk. The following example shows possible
configuration parameters in my.cnf or
my.ini for InnoDB,
including the autoextend attribute.
This example suits most users, both on Unix and Windows, who do
not want to distribute InnoDB data files and
log files on several disks. It creates an auto-extending data file
ibdata1 and two InnoDB log
files ib_logfile0 and
ib_logfile1 in the MySQL data directory.
Also, the small archived InnoDB log file
ib_arch_log_0000000000 that
InnoDB creates automatically ends up in the
data directory.
[mysqld] # You can write your other MySQL server options here # ... # Data files must be able to hold your data and indexes. # Make sure that you have enough free disk space. innodb_data_file_path = ibdata1:10M:autoextend # # Set buffer pool size to 50-80% of your computer's memory set-variable = innodb_buffer_pool_size=70M set-variable = innodb_additional_mem_pool_size=10M # # Set the log file size to about 25% of the buffer pool size set-variable = innodb_log_file_size=20M set-variable = innodb_log_buffer_size=8M # innodb_flush_log_at_trx_commit=1
Make sure that the MySQL server has the proper access rights to create files in the data directory. More generally, the server must have access rights in any directory where it needs to create data files or log files.
Note that data files must be less than 2GB in some filesystems. The combined size of the log files must be less than 4GB. The combined size of data files must be at least 10MB.
When you create an InnoDB tablespace for the
first time, it is best that you start the MySQL server from the
command prompt. InnoDB then prints the
information about the database creation to the screen, so you can
see what is happening. For example, on Windows, if
mysqld-max is located in
C:\mysql\bin, you can start it like this:
C:\> C:\mysql\bin\mysqld-max --console
If you do not send server output to the screen, check the server's
error log to see what InnoDB prints during the
startup process.
See Section 14.2.5, “Creating the InnoDB Tablespace” for an example of what the
information displayed by InnoDB should look
like.
Where to specify options on Windows? The rules for option files on Windows are as follows:
Only one of my.cnf or
my.ini should be created.
The my.cnf file should be placed in the
root directory of the C: drive.
The my.ini file should be placed in the
WINDIR directory; for example,
C:\WINDOWS or
C:\WINNT. You can use the
SET command at the command prompt in a
console window to print the value of
WINDIR:
C:\> SET WINDIR
windir=C:\WINNT
If your PC uses a boot loader where the
C: drive is not the boot drive, your only
option is to use the my.ini file.
If you installed MySQL using the installation and
configuration wizards, the my.ini file is
located in your MySQL installation directory. See
Section 2.3.5.14, “The Location of the my.ini File”.
Where to specify options on Unix? On Unix, mysqld reads options from the following files, if they exist, in the following order:
/etc/my.cnf
Global options.
$MYSQL_HOME/my.cnf
Server-specific options.
defaults-extra-file
The file specified with the
--defaults-extra-file option.
~/.my.cnf
User-specific options.
MYSQL_HOME represents an environment variable,
which contains a path to the directory containing the
server-specific my.cnf file.
If you want to make sure that mysqld reads
options only from a specific file, you can use the
--defaults-option as the first option on the
command line when starting the server:
mysqld --defaults-file=your_path_to_my_cnf
An advanced my.cnf
example. Suppose that you have a Linux computer with
2GB RAM and three 60GB hard disks (at directory paths
/, /dr2 and
/dr3). The following example shows possible
configuration parameters in my.cnf for
InnoDB.
[mysqld] # You can write your other MySQL server options here # ... innodb_data_home_dir = # # Data files must be able to hold your data and indexes innodb_data_file_path = /ibdata/ibdata1:2000M;/dr2/ibdata/ibdata2:2000M:autoextend # # Set buffer pool size to 50-80% of your computer's memory, # but make sure on Linux x86 total memory usage is < 2GB innodb_buffer_pool_size=1G innodb_additional_mem_pool_size=20M innodb_log_group_home_dir = /dr3/iblogs # innodb_log_files_in_group = 2 # # Set the log file size to about 25% of the buffer pool size innodb_log_file_size=250M innodb_log_buffer_size=8M # innodb_flush_log_at_trx_commit=1 innodb_lock_wait_timeout=50 # # Uncomment the next lines if you want to use them #innodb_thread_concurrency=5
Note that the example places the two data files on different
disks. InnoDB fills the tablespace beginning
with the first data file. In some cases, it improves the
performance of the database if all data is not placed on the same
physical disk. Putting log files on a different disk from data is
very often beneficial for performance. You can also use raw disk
partitions (raw devices) as InnoDB data files,
which may speed up I/O. See Section 14.2.14.2, “Using Raw Devices for the Tablespace”.
Warning: On 32-bit GNU/Linux x86,
you must be careful not to set memory usage too high.
glibc may allow the process heap to grow over
thread stacks, which crashes your server. It is a risk if the
value of the following expression is close to or exceeds 2GB:
innodb_buffer_pool_size + key_buffer_size + max_connections*(sort_buffer_size+read_buffer_size+binlog_cache_size) + max_connections*2MB
Each thread uses a stack (often 2MB, but only 256KB in MySQL AB
binaries) and in the worst case also uses
sort_buffer_size + read_buffer_size additional
memory.
By compiling MySQL yourself, you can use up to 64GB of physical
memory in 32-bit Windows. See the description for
innodb_buffer_pool_awe_mem_mb in
Section 14.2.4, “InnoDB Startup Options”.
How to tune other mysqld server parameters? The following values are typical and suit most users:
[mysqld]
skip-external-locking
max_connections=200
read_buffer_size=1M
sort_buffer_size=1M
#
# Set key_buffer to 5 - 50% of your RAM depending on how much
# you use MyISAM tables, but keep key_buffer_size + InnoDB
# buffer pool size < 80% of your RAM
key_buffer_size=value
This section describes the InnoDB-related
server options, all of which can be specified in
--
form on the command line or in option files.
opt_name=value
innodb_additional_mem_pool_size
The size of a memory pool InnoDB uses to
store data dictionary information and other internal data
structures. The more tables you have in your application, the
more memory you need to allocate here. If
InnoDB runs out of memory in this pool, it
starts to allocate memory from the operating system, and
writes warning messages to the MySQL error log. The default
value is 1MB.
innodb_autoextend_increment
The increment size (in megabytes) for extending the size of an autoextending tablespace when it becomes full. The default value is 8. This option can be changed at runtime as a global system variable.
innodb_buffer_pool_awe_mem_mb
The size of the buffer pool (in MB), if it is placed in the
AWE memory of 32-bit Windows. (Relevant only in 32-bit
Windows.) If your 32-bit Windows operating system supports
more than 4GB memory, using so-called “Address Windowing
Extensions”, you can allocate the
InnoDB buffer pool into the AWE physical
memory using this parameter. The maximum possible value for
this is 64000. If this parameter is specified,
innodb_buffer_pool_size is the window in
the 32-bit address space of mysqld where
InnoDB maps that AWE memory. A good value
for innodb_buffer_pool_size is 500MB.
To take advantage of AWE memory, you will need to recompile
MySQL yourself. The current project settings needed for doing
this can be found in the
innobase/os/os0proj.c source file.
innodb_buffer_pool_size
The size of the memory buffer InnoDB uses
to cache data and indexes of its tables. The larger you set
this value, the less disk I/O is needed to access data in
tables. On a dedicated database server, you may set this to up
to 80% of the machine physical memory size. However, do not
set it too large because competition for the physical memory
might cause paging in the operating system.
innodb_checksums
InnoDB uses checksum validation on all
pages read from the disk to ensure extra fault tolerance
against broken hardware or data files. However, under some
rare circumstances (such as when running benchmarks) this
extra safety feature is unneeded. In such cases, this option
(which is enabled by default) can be turned off with
--skip-innodb-checksums. This option was
added in MySQL 5.0.3.
innodb_commit_concurrency
The number of threads that can commit at the same time. A value of 0 disables concurrency control. This option was added in MySQL 5.0.12.
innodb_concurrency_tickets
The number of threads that can enter InnoDB
concurrently is determined by the
innodb_thread_concurrency variable. A
thread is placed in a queue when it tries to enter
InnoDB if the number of threads has already
reached the concurrency limit. When a thread is allowed to
enter InnoDB, it is given a number of
“free tickets” equal to the value of
innodb_concurrency_tickets, and the thread
can enter and leave InnoDB freely until it
has used up its tickets. After that point, the thread again
becomes subject to the concurrency check (and possible
queuing) the next time it tries to enter
InnoDB. This option was added in MySQL
5.0.3.
innodb_data_file_path
The paths to individual data files and their sizes. The full
directory path to each data file is acquired by concatenating
innodb_data_home_dir to each path specified
here. The file sizes are specified in megabytes or gigabytes
(1024MB) by appending M or
G to the size value. The sum of the sizes
of the files must be at least 10MB. On some operating systems,
files must be less than 2GB. If you do not specify
innodb_data_file_path, the default behavior
starting is to create a single 10MB auto-extending data file
named ibdata1. You can set the file size
to more than 4GB on those operating systems supporting big
files. You can also use raw disk partitions as data files. See
Section 14.2.14.2, “Using Raw Devices for the Tablespace”.
innodb_data_home_dir
The common part of the directory path for all
InnoDB data files. If you do not set this
value, the default is the MySQL data directory. You can
specify this also as an empty string, in which case you can
use absolute file paths in
innodb_data_file_path.
innodb_doublewrite
By default, InnoDB stores all data twice,
first to the doublewrite buffer, and then to the actual data
files. This option can be used to disable this functionality.
Like innodb_checksums, this option is
enabled by default; it can be turned off with
--skip-innodb-doublewrite for benchmarks or
cases when top performance is needed rather than concern for
data integrity or possible failures. This option was added in
MySQL 5.0.3.
innodb_fast_shutdown
If you set this to 0, InnoDB does a full
purge and an insert buffer merge before a shutdown. These
operations can take minutes, or even hours in extreme cases.
If you set this parameter to 1, InnoDB
skips these operations at shutdown. The default value is 1. If
you set it to 2 (available starting from MySQL 5.0.5, except
on Netware), InnoDB will just flush its logs and then shut
down cold, as if MySQL had crashed; no committed transaction
will be lost, but a crash recovery will be done at next
startup.
innodb_file_io_threads
The number of file I/O threads in InnoDB.
Normally this should be left at the default value of 4, but
disk I/O on Windows may benefit from a larger number. On Unix,
increasing the number has no effect; InnoDB
always uses the default value.
innodb_file_per_table
This option causes InnoDB to create each
new table using its own .ibd file for
storing data and indexes, rather than in the shared
tablespace. See Section 14.2.6.6, “Using Per-Table Tablespaces”.
innodb_flush_log_at_trx_commit
When innodb_flush_log_at_trx_commit is set
to 0, once per second the log buffer is written out to the log
file, and the flush to disk operation is performed on the log
file, but nothing is done at a transaction commit. When this
value is 1 (the default), at each transaction commit the log
buffer is written out to the log file, and the flush to disk
operation is performed on the log file. When set to 2, at each
commit the log buffer is written out to the file, but the
flush to disk operation is not performed on it. However, the
flushing on the log file takes place once per second also in
the case of 2. We must note that the once-per-second flushing
is not 100% guaranteed to happen every second, due to process
scheduling issues. You can achieve better performance by
setting the value different from 1, but then you can lose at
most one second worth of transactions in a crash. If you set
the value to 0, then any mysqld process
crash can erase the last second of transactions. If you set
the value to 2, then only an operating system crash or a power
outage can erase the last second of transactions. However,
InnoDB's crash recovery is not affected and thus crash
recovery does work regardless of the value. Note that many
operating systems and some disk hardware fool the
flush-to-disk operation. They may tell
mysqld that the flush has taken place,
though it has not. Then the durability of transactions is not
guaranteed even with the setting 1, and in the worst case a
power outage can even corrupt the InnoDB database. Using a
battery-backed disk cache in the SCSI disk controller or in
the disk itself speeds up file flushes, and makes the
operation safer. You can also try using the Unix command
hdparm to disable the caching of disk
writes in hardware caches, or use some other command specific
to the hardware vendor. The default value of this option is 1.
innodb_flush_method
This option is relevant only on Unix systems. If set to
fdatasync (the default),
InnoDB uses fsync() to
flush both the data and log files. If set to
O_DSYNC, InnoDB uses
O_SYNC to open and flush the log files, but
uses fsync() to flush the data files. If
O_DIRECT is specified (available on some
GNU/Linux versions), InnoDB uses
O_DIRECT to open the data files, and uses
fsync() to flush both the data and log
files. Note that InnoDB uses
fsync() instead of
fdatasync(), and it does not use
O_DSYNC by default because there have been
problems with this on many varieties of Unix.
innodb_force_recovery
Warning: This option should be defined only in an emergency
situation when you want to dump your tables from a corrupt
database! Possible values are from 1 to 6. The meanings of
these values are described in
Section 14.2.8.1, “Forcing Recovery”. As a safety measure,
InnoDB prevents a user from modifying data
when this option is greater than 0.
innodb_lock_wait_timeout
The timeout in seconds an InnoDB
transaction may wait for a lock before being rolled back.
InnoDB automatically detects transaction
deadlocks in its own lock table and rolls back the
transaction. InnoDB notices locks set using the LOCK
TABLES statement. The default is 50 seconds.
For the greatest possible durability and consistency in a
replication setup you should use
innodb_flush_log_at_trx_commit=1,
sync-binlog=1, and, before MySQL 5.0.3,
innodb_safe_binlog in your master
my.cnf file.
(innodb_safe_binlog is not needed from
5.0.3 on.)
innodb_locks_unsafe_for_binlog
This option turns off next-key locking in
InnoDB searches and index scans. Default
value for this option is false.
Normally InnoDB uses an algorithm called
next-key locking .
InnoDB performs row-level locking in such a
way that when it searches or scans a table index, it sets
shared or exclusive locks on any index records it encounters.
Thus, the row-level locks are actually index record locks. The
locks that InnoDB sets on index records
also affect the “gap” preceeding that index
record. If a user has a shared or exclusive lock on record
R in an index, another user cannot insert
a new index record immediately before R
in the order of the index. This option causes
InnoDB not to use next-key locking in
searches or index scans. Next-key locking is still used to
ensure foreign key constraints and duplicate key checking.
Note that using this option may cause phantom problems:
Suppose that you want to read and lock all children from the
child table with an identifier value larger
than 100, with the intention of updating some column in the
selected rows later:
SELECT * FROM child WHERE id > 100 FOR UPDATE;
Suppose that there is an index on the id
column. The query scans that index starting from the first
record where id is greater than 100. If the
locks set on the index records do not lock out inserts made in
the gaps, a new row is meanwhile inserted into the table. If
you execute the same SELECT within the same
transaction, you see a new row in the result set returned by
the query. This also means, that if new items are added to the
database, InnoDB does not guarantee serializability; however,
conflict serializability is still guaranteed. Therefore, if
this option is used InnoDB guarantees at most isolation level
READ COMMITTED.
Starting from MySQL 5.0.2 this option is even more unsafe.
InnoDB in an UPDATE or a
DELETE only locks rows that it updates or
deletes. This greatly reduces the probability of deadlocks but
they can happen. Note that this option still does not allow
operations such as UPDATE to overtake like
operations (such as another UPDATE) even in
the case when they affect different rows. Consider the
following example:
CREATE TABLE A(A INT NOT NULL, B INT); INSERT INTO A VALUES (1,2),(2,3),(3,2),(4,3),(5,2); COMMIT;
If one connection executes a query:
SET AUTOCOMMIT = 0; UPDATE A SET B = 5 WHERE B = 3;
and the other connection executes, following the first one, another query:
SET AUTOCOMMIT = 0; UPDATE A SET B = 4 WHERE B = 2;
Then query two has to wait for a commit or rollback of query
one, because query one has an exclusive lock to row (2,3), and
query two while scanning rows also tries to take an exclusive
lock to the same row (2,3), which it cannot have. This is
because query two first takes an exclusive lock on a row and
then determines whether this row belongs to the result set,
and if not then releases the unnecessary lock, when the option
innodb_locks_unsafe_for_binlog is used.
Therefore, query one is executed as follows:
x-lock(1,2) unlock(1,2) x-lock(2,3) update(2,3) to (2,5) x-lock(3,2) unlock(3,2) x-lock(4,3) update(4,3) to (4,5) x-lock(5,2) unlock(5,2)
and then query two is executed as follows:
x-lock(1,2) update(1,2) to (1,4) x-lock(2,3) - wait for query one to commit or rollback
innodb_log_arch_dir
The directory where fully written log files would be archived
if we used log archiving. If used, the value of this parameter
should be set the same as
innodb_log_group_home_dir. However, it is
not required.
innodb_log_archive
This value should currently be set to 0. Because recovery from
a backup is done by MySQL using its own log files, there is
currently no need to archive InnoDB log
files. The default for this option is 0.
innodb_log_buffer_size
The size of the buffer that InnoDB uses to
write to the log files on disk. Sensible values range from 1MB
to 8MB. The default is 1MB. A large log buffer allows large
transactions to run without a need to write the log to disk
before the transactions commit. Thus, if you have big
transactions, making the log buffer larger saves disk I/O.
innodb_log_file_size
The size of each log file in a log group. The combined size of
log files must be less than 4GB on 32-bit computers. The
default is 5MB. Sensible values range from 1MB to
1/N-th of the size of the buffer
pool, below, where N is the number
of log files in the group. The larger the value, the less
checkpoint flush activity is needed in the buffer pool, saving
disk I/O. But larger log files also mean that recovery is
slower in case of a crash.
innodb_log_files_in_group
The number of log files in the log group.
InnoDB writes to the files in a circular
fashion. The default is 2 (recommended).
innodb_log_group_home_dir
The directory path to the InnoDB log files.
It must have the same value as
innodb_log_arch_dir. If you do not specify
any InnoDB log parameters, the default is
to create two 5MB files names ib_logfile0
and ib_logfile1 in the MySQL data
directory.
innodb_max_dirty_pages_pct
This is an integer in the range from 0 to 100. The default is
90. The main thread in InnoDB tries to
write pages from the buffer pool so that the percentage of
dirty (not yet written) pages will not exceed this value. If
you have the SUPER privilege, this
percentage can be changed while the server is running:
SET GLOBAL innodb_max_dirty_pages_pct = value;
innodb_max_purge_lag
This option controls how to delay INSERT,
UPDATE and DELETE
operations when the purge operations (see
Section 14.2.12, “Implementation of Multi-Versioning”) are lagging. The
default value of this parameter is zero, meaning that there
are no delays. This option can be changed at runtime as a
global system variable.
The InnoDB transaction system maintains a list of transactions
that have delete-marked index records by
UPDATE or DELETE
operations. Let the length of this list be
purge_lag. When
purge_lag exceeds
innodb_max_purge_lag, each
INSERT, UPDATE and
DELETE operation is delayed by
((purge_lag/innodb_max_purge_lag)*10)-5
milliseconds. The delay is computed in the beginning of a
purge batch, every ten seconds. The operations are not delayed
if purge cannot run because of an old consistent read view
that could see the rows to be purged.
A typical setting for a problematic workload might be 1 million, assuming that our transactions are small, only 100 bytes in size, and we can allow 100 MB of unpurged rows in our tables.
innodb_mirrored_log_groups
The number of identical copies of log groups we keep for the database. Currently this should be set to 1.
innodb_open_files
This option is relevant only if you use multiple tablespaces
in InnoDB. It specifies the maximum number
of .ibd files that
InnoDB can keep open at one time. The
minimum value is 10. The default is 300.
The file descriptors used for .ibd files
are for InnoDB only. They are independent
of those specified by the --open-files-limit
server option, and do not affect the operation of the table
cache.
innodb_safe_binlog
Adds consistency guarantees between the content of
InnoDB tables and the binary log. See
Section 5.11.3, “The Binary Log”. This variable was removed in
MySQL 5.0.3, having been made obsolete by the introduction of
XA transaction support.
innodb_status_file
This option causes InnoDB to create a file
for periodical <datadir>/innodb_status.<pid>SHOW ENGINE INNODB STATUS
output.
innodb_support_xa
When set to ON or 1 (the default), this
variable enables InnoDB support for
two-phase commit in XA transactions. Enabling
innodb_support_xa causes an extra disk
flush for transaction preparation. If you don't care about
using XA, you can disable this variable by setting it to
OFF or 0 to reduce the number of disk
flushes and get better InnoDB performance.
This variable was added in MySQL 5.0.3.
innodb_sync_spin_loops
The number of times a thread waits for an
InnoDB mutex to be freed before the thread
is suspended. This option was added in MySQL 5.0.3.
innodb_table_locks
InnoDB honors LOCK
TABLES; MySQL does not return from LOCK
TABLE .. WRITE until all other threads have released
all their locks to the table. The default value is 1, which
means that LOCK TABLES causes InnoDB to
lock a table internally. In applications using
AUTOCOMMIT=1, InnoDB's internal table locks
can cause deadlocks. You can set
innodb_table_locks=0 in
my.cnf (or my.ini on
Windows) to remove that problem.
innodb_thread_concurrency
InnoDB tries to keep the number of
operating system threads concurrently inside
InnoDB less than or equal to the limit
given by this parameter. Before MySQL 5.0.8, the default value
is 8. If you have performance issues, and SHOW INNODB
STATUS reveals many threads waiting for semaphores,
you may have thread “thrashing” and should try
setting this parameter lower or higher. If you have a computer
with many processors and disks, you can try setting the value
higher to make better use of your computer's resources. A
recommended value is the sum of the number of processors and
disks your system has. A value of 500 or greater disables
concurrency checking. Starting with MySQL 5.0.8, the default
value is 20, and concurrency checking will be disabled if the
setting is greater than or equal to 20.
Suppose that you have installed MySQL and have edited your option
file so that it contains the necessary InnoDB
configuration parameters. Before starting MySQL, you should verify
that the directories you have specified for
InnoDB data files and log files exist and that
the MySQL server has access rights to those directories.
InnoDB cannot create directories, only files.
Check also that you have enough disk space for the data and log
files.
It is best to run the MySQL server mysqld from
the command prompt when you create an InnoDB
database, not from the mysqld_safe wrapper or
as a Windows service. When you run from a command prompt you see
what mysqld prints and what is happening. On
Unix, just invoke mysqld. On Windows, use the
--console option.
When you start the MySQL server after initially configuring
InnoDB in your option file,
InnoDB creates your data files and log files.
InnoDB prints something like the following:
InnoDB: The first specified datafile /home/heikki/data/ibdata1 did not exist: InnoDB: a new database to be created! InnoDB: Setting file /home/heikki/data/ibdata1 size to 134217728 InnoDB: Database physically writes the file full: wait... InnoDB: datafile /home/heikki/data/ibdata2 did not exist: new to be created InnoDB: Setting file /home/heikki/data/ibdata2 size to 262144000 InnoDB: Database physically writes the file full: wait... InnoDB: Log file /home/heikki/data/logs/ib_logfile0 did not exist: new to be created InnoDB: Setting log file /home/heikki/data/logs/ib_logfile0 size to 5242880 InnoDB: Log file /home/heikki/data/logs/ib_logfile1 did not exist: new to be created InnoDB: Setting log file /home/heikki/data/logs/ib_logfile1 size to 5242880 InnoDB: Doublewrite buffer not found: creating new InnoDB: Doublewrite buffer created InnoDB: Creating foreign key constraint system tables InnoDB: Foreign key constraint system tables created InnoDB: Started mysqld: ready for connections
A new InnoDB database has been created. You can
connect to the MySQL server with the usual MySQL client programs
like mysql. When you shut down the MySQL server
with mysqladmin shutdown, the output is like
the following:
010321 18:33:34 mysqld: Normal shutdown 010321 18:33:34 mysqld: Shutdown Complete InnoDB: Starting shutdown... InnoDB: Shutdown completed
You can look at the data file and log directories and you see the
files created. The log directory also contains a small file named
ib_arch_log_0000000000. That file resulted
from the database creation, after which InnoDB
switched off log archiving. When MySQL is started again, the data
files and log files have been created, so the output is much
briefer:
InnoDB: Started mysqld: ready for connections
You can add the option innodb_file_per_table to
my.cnf, and make InnoDB to store each table
into its own .ibd file in a database
directory of MySQL. See Section 14.2.6.6, “Using Per-Table Tablespaces”.
If InnoDB prints an operating system error in
a file operation, usually the problem is one of the following:
You did not create the InnoDB data file
directory or the InnoDB log directory.
mysqld does not have access rights to create files in those directories.
mysqld cannot not read the proper
my.cnf or my.ini
option file, and consequently does not see the options you
specified.
The disk is full or a disk quota is exceeded.
You have created a subdirectory whose name is equal to a data file you specified.
There is a syntax error in
innodb_data_home_dir or
innodb_data_file_path.
If something goes wrong when InnoDB attempts
to initialize its tablespace or its log files, you should delete
all files created by InnoDB. This means all
ibdata files and all
ib_logfiles. In case you created some
InnoDB tables, delete the corresponding
.frm files for these tables (and any
.ibd files if you are using multiple
tablespaces) from the MySQL database directories as well. Then
you can try the InnoDB database creation
again. It is best to start the MySQL server from a command
prompt so that you see what is happening.
Suppose that you have started the MySQL client with the command
mysql test. To create an
InnoDB table, you must specify an
ENGINE = InnoDB or TYPE =
InnoDB option in the table creation SQL statement:
CREATE TABLE customers (a INT, b CHAR (20), INDEX (a)) ENGINE=InnoDB; CREATE TABLE customers (a INT, b CHAR (20), INDEX (a)) TYPE=InnoDB;
The SQL statement creates a table and an index on column
a in the InnoDB tablespace
that consists of the data files you specified in
my.cnf. In addition, MySQL creates a file
customers.frm in the
test directory under the MySQL database
directory. Internally, InnoDB adds to its own
data dictionary an entry for table
'test/customers'. This means you can create a
table of the same name customers in some other
database, and the table names do not collide inside
InnoDB.
You can query the amount of free space in the
InnoDB tablespace by issuing a SHOW
TABLE STATUS statement for any InnoDB
table. The amount of free space in the tablespace appears in the
Comment section in the output of SHOW
TABLE STATUS. An example:
SHOW TABLE STATUS FROM test LIKE 'customers'
Note that the statistics SHOW gives about
InnoDB tables are only approximate. They are
used in SQL optimization. Table and index reserved sizes in bytes
are accurate, though.
By default, each client that connects to the MySQL server begins
with autocommit mode enabled, which automatically commits every
SQL statement you run. To use multiple-statement transactions,
you can switch autocommit off with the SQL statement
SET AUTOCOMMIT = 0 and use
COMMIT and ROLLBACK to
commit or roll back your transaction. If you want to leave
autocommit on, you can enclose your transactions between
START TRANSACTION and
COMMIT or ROLLBACK. The
following example shows two transactions. The first is
committed; the second is rolled back.
shell>mysql testWelcome to the MySQL monitor. Commands end with ; or \g. Your MySQL connection id is 5 to server version: 3.23.50-log Type 'help;' or '\h' for help. Type '\c' to clear the buffer. mysql>CREATE TABLE CUSTOMER (A INT, B CHAR (20), INDEX (A))->ENGINE=InnoDB;Query OK, 0 rows affected (0.00 sec) mysql>BEGIN;Query OK, 0 rows affected (0.00 sec) mysql>INSERT INTO CUSTOMER VALUES (10, 'Heikki');Query OK, 1 row affected (0.00 sec) mysql>COMMIT;Query OK, 0 rows affected (0.00 sec) mysql>SET AUTOCOMMIT=0;Query OK, 0 rows affected (0.00 sec) mysql>INSERT INTO CUSTOMER VALUES (15, 'John');Query OK, 1 row affected (0.00 sec) mysql>ROLLBACK;Query OK, 0 rows affected (0.00 sec) mysql>SELECT * FROM CUSTOMER;+------+--------+ | A | B | +------+--------+ | 10 | Heikki | +------+--------+ 1 row in set (0.00 sec) mysql>
In APIs like PHP, Perl DBI/DBD, JDBC, ODBC, or the standard C
call interface of MySQL, you can send transaction control
statements such as COMMIT to the MySQL server
as strings just like any other SQL statements such as
SELECT or INSERT. Some
APIs also offer separate special transaction commit and rollback
functions or methods.
Important: You should not convert MySQL system tables in the
mysql database (such as
user or host) to the
InnoDB type. The system tables must always be
of the MyISAM type.
If you want all your (non-system) tables to be created as
InnoDB tables, you can simply add the line
default-table-type=innodb to the
[mysqld] section of your
my.cnf or my.ini file.
InnoDB does not have a special optimization
for separate index creation the way the
MyISAM storage engine does. Therefore, it
does not pay to export and import the table and create indexes
afterward. The fastest way to alter a table to
InnoDB is to do the inserts directly to an
InnoDB table. That is, use ALTER
TABLE ... ENGINE=INNODB, or create an empty
InnoDB table with identical definitions and
insert the rows with INSERT INTO ... SELECT * FROM
....
If you have UNIQUE constraints on secondary
keys, you can speed up a table import by turning off the
uniqueness checks temporarily during the import session:
SET UNIQUE_CHECKS=0;. For big tables, this
saves a lot of disk I/O because InnoDB can
then use its insert buffer to write secondary index records as a
batch.
To get better control over the insertion process, it might be good to insert big tables in pieces:
INSERT INTO newtable SELECT * FROM oldtable WHERE yourkey > something AND yourkey <= somethingelse;
After all records have been inserted, you can rename the tables.
During the conversion of big tables, you should increase the size of the