Compare with

Comparison of OpenJPA with Derby embedded vs EclipseLink with HSQLDB server

Each of the following tables focuses on a specific database operation, where the last table presents average results comparison.

Speed comparison of JPA database persistence operations (normalized score, higher is better)

Transaction Size =>Few EntitiesMany EntitiesAverage Score
 OpenJPA
Derby embedded
EclipseLink
HSQLDB server
OpenJPA
Derby embedded
EclipseLink
HSQLDB server
OpenJPA
Derby embedded
EclipseLink
HSQLDB server
Basic Person Test6.612.26.420.96.516.6
Element Collection Test7.111.65.5failed6.311.6
Inheritance Test4.1failed5.6failed4.9failed
Indexing Test6.3failed6.8failed6.5failed
Graph (Binary Tree) Test2.3failed2.5failed2.4failed
Multithreading Test7.2failed0.0000failed3.6failed
All Tests5.611.94.520.95.014.9

EclipseLink with HSQLDB server has failed in 9 tests (see exceptions).

Speed comparison of JPA database retrieval operations (normalized score, higher is better)

Retrieval Size =>Few EntitiesMany EntitiesAverage Score
 OpenJPA
Derby embedded
EclipseLink
HSQLDB server
OpenJPA
Derby embedded
EclipseLink
HSQLDB server
OpenJPA
Derby embedded
EclipseLink
HSQLDB server
Basic Person Test14.72.628.914.621.88.6
Element Collection Test1.01.414.9failed8.01.4
Inheritance Test1.4failed18.0failed9.7failed
Indexing Test20.1failed31.4failed25.7failed
Graph (Binary Tree) Test0.35failed1.5failed0.92failed
Multithreading Test20.1failed26.3failed23.2failed
All Tests9.62.020.214.614.96.2

EclipseLink with HSQLDB server has failed in 9 tests (see exceptions).

Speed comparison of JPA database query operations (normalized score, higher is better)

Retrieval Size =>Few EntitiesMany EntitiesAverage Score
 OpenJPA
Derby embedded
EclipseLink
HSQLDB server
OpenJPA
Derby embedded
EclipseLink
HSQLDB server
OpenJPA
Derby embedded
EclipseLink
HSQLDB server
Basic Person Test1.30.538.63.05.01.8
Element Collection Test0.410.980.95failed0.680.98
Inheritance Test0.24failed1.1failed0.66failed
Indexing Test9.1failed17.7failed13.4failed
Multithreading Test5.2failed10.6failed7.9failed
All Tests3.20.757.83.05.51.5

EclipseLink with HSQLDB server has failed in 7 tests (see exceptions).

Speed comparison of JPA database update operations (normalized score, higher is better)

Transaction Size =>Few EntitiesMany EntitiesAverage Score
 OpenJPA
Derby embedded
EclipseLink
HSQLDB server
OpenJPA
Derby embedded
EclipseLink
HSQLDB server
OpenJPA
Derby embedded
EclipseLink
HSQLDB server
Basic Person Test2.21.95.17.53.64.7
Element Collection Test2.63.14.6failed3.63.1
Inheritance Test1.0failed5.3failed3.2failed
Indexing Test7.0failed7.5failed7.2failed
Graph (Binary Tree) Test1.3failed1.0failed1.2failed
Multithreading Test4.9failed5.5failed5.2failed
All Tests3.22.54.87.54.04.2

EclipseLink with HSQLDB server has failed in 9 tests (see exceptions).

Speed comparison of JPA database removal operations (normalized score, higher is better)

Transaction Size =>Few EntitiesMany EntitiesAverage Score
 OpenJPA
Derby embedded
EclipseLink
HSQLDB server
OpenJPA
Derby embedded
EclipseLink
HSQLDB server
OpenJPA
Derby embedded
EclipseLink
HSQLDB server
Basic Person Test8.69.58.133.18.421.3
Element Collection Test6.26.71.3failed3.76.7
Inheritance Test7.3failed4.3failed5.8failed
Indexing Test15.2failed6.0failed10.6failed
Graph (Binary Tree) Test5.6failed8.3failed6.9failed
Multithreading Test5.5failed0.0000failed2.7failed
All Tests8.18.14.733.16.416.4

EclipseLink with HSQLDB server has failed in 9 tests (see exceptions).

Comparison of JPA/Database speed - the averages (normalized score, higher is better)

Transaction/Retrieval SizeFew EntitiesMany EntitiesAverage Score
 OpenJPA
Derby embedded
EclipseLink
HSQLDB server
OpenJPA
Derby embedded
EclipseLink
HSQLDB server
OpenJPA
Derby embedded
EclipseLink
HSQLDB server
Basic Person Test6.75.411.415.89.110.6
Element Collection Test3.54.85.4failed4.54.8
Inheritance Test2.8failed6.9failed4.8failed
Indexing Test11.5failed13.9failed12.7failed
Graph (Binary Tree) Test2.4failed3.3failed2.9failed
Multithreading Test8.6failed8.5failed8.5failed
All Tests6.05.18.415.87.28.6

The results above show that in general EclipseLink with HSQLDB server is slightly more efficient than OpenJPA with Derby embedded in performing JPA database operations.

Other Head to Head DBMS/JPA Comparisons