Comparison of DataNucleus with SQLite embedded vs ObjectDB embedded

Each of the following tables focuses on a specific database operation, where the last table presents average results comparison.

Speed comparison of JPA database persistence operations (normalized score, higher is better)

Transaction Size =>	Few Entities		Many Entities		Average Score
	DataNucleus SQLite embedded	ObjectDB embedded	DataNucleus SQLite embedded	ObjectDB embedded	DataNucleus SQLite embedded	ObjectDB embedded
Basic Person Test		100		100		100
Element Collection Test		100		100		100
Inheritance Test		100		100		100
Indexing Test		100		100		100
Graph (Binary Tree) Test		100		100		100
Multithreading Test		69.7		0.0000		34.8
All Tests		94.9		83.3		89.1

Speed comparison of JPA database retrieval operations (normalized score, higher is better)

Retrieval Size =>	Few Entities		Many Entities		Average Score
	DataNucleus SQLite embedded	ObjectDB embedded	DataNucleus SQLite embedded	ObjectDB embedded	DataNucleus SQLite embedded	ObjectDB embedded
Basic Person Test	0.43	100		100	0.43	100
Element Collection Test		100		100		100
Inheritance Test		100		100		100
Indexing Test		100		100		100
Graph (Binary Tree) Test		100		100		100
Multithreading Test		100		100		100
All Tests	0.43	100		100	0.43	100

The results above show that in general ObjectDB embedded is much more efficient than DataNucleus with SQLite embedded in retrieving JPA entity objects from the database. Comparing the normalized speed of DataNucleus with SQLite embedded database (0.43) to the normalized speed of ObjectDB embedded database (100) reveals that in these tests, ObjectDB embedded is 233 times faster than DataNucleus with SQLite embedded.

A huge performance gap has been detected when using simple basic entities with small retrieval size. Comparing the normalized speed of DataNucleus with SQLite embedded database (0.43) to the normalized speed of ObjectDB embedded database (100) reveals that in that case, ObjectDB embedded is 233 times faster than DataNucleus with SQLite embedded.

Speed comparison of JPA database query operations (normalized score, higher is better)

Retrieval Size =>	Few Entities		Many Entities		Average Score
	DataNucleus SQLite embedded	ObjectDB embedded	DataNucleus SQLite embedded	ObjectDB embedded	DataNucleus SQLite embedded	ObjectDB embedded
Basic Person Test	failed	100		100	failed	100
Element Collection Test		100		100		100
Inheritance Test		100		100		100
Indexing Test		100		100		100
Multithreading Test		100		100		100
All Tests	failed	100		100	failed	100

DataNucleus with SQLite embedded has failed in 1 tests (see exceptions).

Speed comparison of JPA database update operations (normalized score, higher is better)

Transaction Size =>	Few Entities		Many Entities		Average Score
	DataNucleus SQLite embedded	ObjectDB embedded	DataNucleus SQLite embedded	ObjectDB embedded	DataNucleus SQLite embedded	ObjectDB embedded
Basic Person Test	0.025	100		100	0.025	100
Element Collection Test		100		100		100
Inheritance Test		100		100		100
Indexing Test		100		100		100
Graph (Binary Tree) Test		100		100		100
Multithreading Test		100		100		100
All Tests	0.025	100		100	0.025	100

The results above show that in general ObjectDB embedded is much more efficient than DataNucleus with SQLite embedded in updating JPA entity objects in the database. Comparing the normalized speed of DataNucleus with SQLite embedded database (0.025) to the normalized speed of ObjectDB embedded database (100) reveals that in these tests, ObjectDB embedded is 4,000 times faster than DataNucleus with SQLite embedded.

A huge performance gap has been detected when using simple basic entities with small transaction size. Comparing the normalized speed of DataNucleus with SQLite embedded database (0.025) to the normalized speed of ObjectDB embedded database (100) reveals that in that case, ObjectDB embedded is 4,000 times faster than DataNucleus with SQLite embedded.

Speed comparison of JPA database removal operations (normalized score, higher is better)

Transaction Size =>	Few Entities		Many Entities		Average Score
	DataNucleus SQLite embedded	ObjectDB embedded	DataNucleus SQLite embedded	ObjectDB embedded	DataNucleus SQLite embedded	ObjectDB embedded
Basic Person Test	0.17	100		29.7	0.17	64.8
Element Collection Test		100		100		100
Inheritance Test		100		89.1		94.6
Indexing Test		66.0		100		83.0
Graph (Binary Tree) Test		60.2		100		80.1
Multithreading Test		100		0.0000		50.0
All Tests	0.17	87.7		69.8	0.17	78.7

The results above show that in general ObjectDB embedded is much more efficient than DataNucleus with SQLite embedded in deleting JPA entity objects from the database. Comparing the normalized speed of DataNucleus with SQLite embedded database (0.17) to the normalized speed of ObjectDB embedded database (78.7) reveals that in these tests, ObjectDB embedded is 463 times faster than DataNucleus with SQLite embedded.

A huge performance gap has been detected when using simple basic entities with small transaction size. Comparing the normalized speed of DataNucleus with SQLite embedded database (0.17) to the normalized speed of ObjectDB embedded database (100) reveals that in that case, ObjectDB embedded is 588 times faster than DataNucleus with SQLite embedded.

Comparison of database storage efficiency (normalized score, higher is better)

Transaction Size =>	Few Entities		Many Entities		Average Score
	DataNucleus SQLite embedded	ObjectDB embedded	DataNucleus SQLite embedded	ObjectDB embedded	DataNucleus SQLite embedded	ObjectDB embedded
Basic Person Test		82.0		82.0		82.0
Element Collection Test		100		100		100
Inheritance Test		89.8		94.5		92.1
Indexing Test		88.2		88.2		88.2
Graph (Binary Tree) Test		32.0		32.0		32.0
Multithreading Test		82.0		82.0		82.0
All Tests		79.0		79.8		79.4

Comparison of JPA/Database speed - the averages (normalized score, higher is better)

Transaction/Retrieval Size	Few Entities		Many Entities		Average Score
	DataNucleus SQLite embedded	ObjectDB embedded	DataNucleus SQLite embedded	ObjectDB embedded	DataNucleus SQLite embedded	ObjectDB embedded
Basic Person Test	0.21	100		85.9	0.21	93.0
Element Collection Test		100		100		100
Inheritance Test		100		97.8		98.9
Indexing Test		93.2		100		96.6
Graph (Binary Tree) Test		90.0		100		95.0
Multithreading Test		93.9		60.0		77.0
All Tests	0.21	96.4		90.3	0.21	93.4

The results above show that in general ObjectDB embedded is much more efficient than DataNucleus with SQLite embedded in performing JPA database operations. Comparing the normalized speed of DataNucleus with SQLite embedded database (0.21) to the normalized speed of ObjectDB embedded database (93.4) reveals that in these tests, ObjectDB embedded is 445 times faster than DataNucleus with SQLite embedded.

A huge performance gap has been detected when using simple basic entities with small transaction/retrieval size. Comparing the normalized speed of DataNucleus with SQLite embedded database (0.21) to the normalized speed of ObjectDB embedded database (100) reveals that in that case, ObjectDB embedded is 476 times faster than DataNucleus with SQLite embedded.

JPA Performance Benchmark (JPAB)