Performance Test
I. Software Quality Assurance
The performance test suite on lexAccess was set up since 2007 version. JavaDb is added and test its performance in 2008. Due to the slow performance, Java DB is dropped in 2009. This test suite tests on:
- Performance
- Quality assurance
Below are the detail descriptions on lexAccess Performance test:
I. Test Procedures
- create directory ${TEST}/LA/PerformanceTest/data/${YEAR}
shell> cd ${TEST}/LA/PerformanceTest/data shell> mkdir 2012
- link 5 files from $TEST/LVG/PerformanceTest/data/${YEAR}/Input
- test.in.100
- test.in.10000
- test.in
- lexiconTerms.data
- meta.data
shell> cd ${TEST}/LA/PerformanceTest/data/2012 shell> mkdir Input shell> cd Input shell> ln -sf /export/home/lu/Test/LVG/PerformanceTest/data/2012/Input/test.in.100 test.in.100 shell> ln -sf /export/home/lu/Test/LVG/PerformanceTest/data/2012/Input/test.in.10000 test.in.10000 shell> ln -sf /export/home/lu/Test/LVG/PerformanceTest/data/2012/Input/test.in test.in shell> ln -sf /export/home/lu/Test/LVG/PerformanceTest/data/2012/Input/lexiconTerms.data lexiconTerms.data shell> ln -sf /export/home/lu/Test/LVG/PerformanceTest/data/2012/Input/meta.data meta.data
- update top LA directory in the config file. lexAccess.property.hsql
- update ${YEAR} in ${TEST}/LA/PerformanceTest/data/${YEAR}/Input/script/testCaseAll
- update ${TEST}/LA/PerformanceTest/bin/PerformanceTest (if needed)
- update ${TEST}/LA/PerformanceTest/bin/testAll (if needed)
- run ${TEST}/LVG/PerformanceTest/bin/testAll or
- run ${TEST}/LVG/PerformanceTest/bin/PerformanceTest (just for 1 DB, HSqlDb)
The test can be performed on software versions and year of data.
II. Quality assurance
Compare the results for all above 5 files for different database, such as HSqlDb and JavaDb. The results of these two databases are under:
- ${TEST}/LA/PerformanceTest/data/${YEAR}/Output_HSql
- ${TEST}/LA/PerformanceTest/data/${YEAR}/Output_JavaDb
III. Performance Test results
Release | Test Platform | 10000 Records | Test: 1462202 Records (2002 Metathesaurus) | Meta: 4461783 records (2007 Metathesaurus) |
---|---|---|---|---|
2007 |
|
|
|
|
2008 |
|
|
|
|
2009 |
|
|
|
|
2010 |
|
|
|
|
2011 |
|
|
|
|
2012 |
|
|
|
|
2013 |
|
|
|
|
2016 |
|
|
|
|
From the results, we conclude:
- The outputs of HSqlDb and JavaDb are the same
- The performance of HSqlDb is about 1~2 magnitude faster than JavaDb