Performance Test

The performance of lvg, norm, and luiNorm has been improved over years by the following factors:

  • Java source code optimization
  • Faster database server (IDB -> MySql -> HSqlDb)
  • Faster JDBC
  • Faster platform (Unix -> Linux)

Flatform Spec:

  • OS: shell> cat /etc/redhat-release
  • shell> uname -a
  • Processsor: shell> sudo dmidecode
  • Memory: shell> free -m
  • There are lots of new enhanced features implemented since 2005 version. In terms of performance, it's not a fair comparison to compare 2005 release to previous versions. Tables below shows performance test for norm and luiNorm.

    I. norm

     Test Environment10000 Records1462203 Records (2002 Metathesaurus)
    C 1_84h
    • Unix, Sun, Ultra-60, Solaris 5.9 Sparc
    49.30u 1.20s 1:23.44 60.5% 13940.62u 463.66s 4:03:09.21 98.7%
    2002
    • Unix, Sun, Ultra-80, Solaris 5.9 Sparc
    • MySql-3.22.25
    • mm.mysql-2.0.6
    125.92u 31.92s 3:15.09 80.9% 32389.38u 14391.48s 15:49:45.63 6.7%
    2003
    • Unix, Sun, Ultra-80, Solaris 5.9 Sparc
    • MySql-3.22.25
    • mm.mysql-2.0.6
    38.88u 3.45s 1:25.73 49.3% 9473.60u 857.01s 4:51:54.42 58.9%
    2002
    (New Db)
    • Unix, Sun, Ultra-80, Solaris 5.9 Sparc
    • MySql-4.0.14
    • mysql-connector-java-3.0.8
    121.99u 49.07s 2:59.40 95.3% 41161.97u 16654.78s 16:39:33.94 96.4%
    2003
    (New Db)
    • Unix, Sun, Ultra-80, Solaris 5.9 Sparc
    • MySql-4.0.14
    • mysql-connector-java-3.0.8
    23.47u 2.79s 0:34.49 76.1% 5443.99u 706.17s 2:13:54.79 76.5%
    2004
    • Unix, Sun, Ultra-80, Solaris 5.9 Sparc
    • MySql-4.0.14
    • mysql-connector-java-3.0.8
    32.92u 5.20s 0:53.48 71.2% 7679.98u 1468.95s 3:33:16.22 71.4%
    2005
    • Red Hat 2.4.21-20, Pentium 3.4GHz, 2 Gb Ram
    • HSqlDb 1.7.2
    13.420u 1.950s 0:41.62 36.9% 3578.770u 52.330s 1:15:38.22 80.0%
    2006
    • Red Hat 2.4.9-11, Pentium 3.4GHz, 2 Gb Ram
    • HSqlDb 1.8.0
    10.679u 0.544s 0:11.37 98.5% 2153.353u 66.258s 38:40.24 95.6%
    2007
    • Red Hat 2.4.9-11, Pentium 3.4GHz, 2 Gb Ram
    • HSqlDb 1.8.0.4
    11.208u 0.569s 0:11.81 99.5% 2764.469u 72.222s 47:56.29 98.6%
    2008
    • Red Hat 2.4.9-11, Pentium 3.4GHz, 2 Gb Ram
    • HSqlDb 1.8.0.7
    11.531u 0.484s 0:12.00 100.0% 2820.537u 59.690s 48:58.33 98.0%
    2009
    • Red Hat 4, 2.6.9-78, Intel-Xeon 3.8GHz, 4 Gb Ram
    • HSqlDb 1.8.0.10
    9.829u 0.451s 0:09.83 104.4% 2185.478u 54.586s 37:18.94 100.0%
    2010
    • Red Hat 5.4, 2.6.18-164.6.1.el5, Intel-Xeon 3333MHz, 4 Gb Ram
    • HSqlDb 1.8.0.10
    8.232u 0.278s 0:06.23 136.4% 2728.102u 65.741s 47:04.88 98.9%
    2011
    • Red Hat 5.5, 2.6.18-194.8.1.el5, Intel-Xeon 3333MHz, 4 Gb Ram
    • HSqlDb 2.0.0
    9.923u 0.389s 0:07.30 141.0% 3211.376u 41.357s 53:42.04 100.9%
    2012
    • Red Hat 5.7, 2.6.18-274.7.1.el5, Intel-Xeon 3333MHz, 4 Gb Ram
    • HSqlDb 2.2.5
    12.284u 0.411s 0:07.50 169.2% 3241.635u 41.307s 54:16.55 100.8%
    2013 (lexlx1)
    • Red Hat Enterprise Linux Client release 5.5 (Tikanga), 2.6.18-308.13.1.el5, Intel-Xeon 3333MHz, 4 Gb Ram
    • HSqlDb 2.2.8
    9.569u 0.425s 0:07.36 135.5% 3025.799u 41.657s 50:33.35 101.1%
    2013 (lexdev)
    • Red Hat Enterprise Linux Workstation release 6.3 (Santiago), 16 Gb Ram
    • HSqlDb 2.2.8
    15.949u 1.074s 0:08.47 200.8% 3193.846u 91.376s 50:09.72 109.1%
    2014 (lexdev)
    • Red Hat Enterprise Linux Workstation release 6.4 (Santiago)
    • Intel(R) Xeon(R) CPU E5506 @ 2.13GHz, 16 Gb Ram
    • HSqlDb 2.3.0
    15.700u 0.965s 0:08.76 190.1% 4140.662u 81.331s 1:06:21.30 106.0%
    2015 (lexdev)
    • Red Hat Enterprise Linux Workstation release 6.5 (Santiago)
    • Intel(R) Xeon(R) CPU E5506 @ 2.13GHz, 48 Gb Ram
    • HSqlDb 2.3.2
    16.913u 0.884s 0:09.15 194.4% 4205.883u 81.314s 1:17:34.76 92.1%

    II. luiNorm

    Test dataTest Environment10000 Records1462203 Records (2002 Metathesaurus)
    C 1_84h
    • Unix, Sun, Ultra-60, Solaris 5.9 Sparc
    52.01u 1.78s 1:35.58 56.2% 14394.76u 720.45s 4:22:12.19 96.0%
    2002
    • Unix, Sun, Ultra-80, Solaris 5.9 Sparc
    • MySql-3.22.25
    • mm.mysql-2.0.6
    125.14u 34.82s 3:39.44 72.8% 34111.04u 14941.83s 17:01:37.05 9.9%
    2003
    • Unix, Sun, Ultra-80, Solaris 5.9 Sparc
    • MySql-3.22.25
    • mm.mysql-2.0.6
    50.08u 5.55s 1:50.36 50.4% 11993.57u 1330.25s 6:59:42.42 52.9%
    2002
    (new Db)
    • Unix, Sun, Ultra-80, Solaris 5.9 Sparc
    • MySql-4.0.14
    • mysql-connector-java-3.0.8
    126.22u 50.37s 3:11.37 92.2% 41827.16u 17607.38s 17:29:45.35 94.3%
    2003
    (new Db)
    • Unix, Sun, Ultra-80, Solaris 5.9 Sparc
    • MySql-4.0.14
    • mysql-connector-java-3.0.8
    29.12u 4.55s 0:48.21 69.8% 6857.08u 1171.96s 3:09:17.85 70.6%
    2004
    • Unix, Sun, Ultra-80, Solaris 5.9 Sparc
    • MySql-4.0.14
    • mysql-connector-java-3.0.8
    29.73u 5.36s 0:49.49 70.9% 6740.90u 1259.28s 3:05:24.25 71.9%
    2005
    • Red Hat 2.4.21-20, Pentium 3.4GHz, 2 Gb Ram
    • HSqlDb 1.7.2
    12.530u 0.840s 0:55.54 24.0% 2875.820u 81.370s 1:01:40.41 79.9%
    2006
    • Red Hat 2.4.9-11, Pentium 3.4GHz, 2 Gb Ram
    • HSqlDb 1.8.0
    10.480u 0.562s 0:11.17 98.8% 1990.414u 95.871s 36:56.10 94.1%
    2007
    • Red Hat 2.4.9-11, Pentium 3.4GHz, 2 Gb Ram
    • HSqlDb 1.8.0.4
    10.878u 0.662s 0:11.57 99.6% 2348.834u 106.469s 41:25.72 98.7%
    2008
    • Red Hat 2.4.9-11, Pentium 3.4GHz, 2 Gb Ram
    • HSqlDb 1.8.0.7
    11.050u 0.536s 0:11.60 99.8% 2551.715u 83.859s 44:54.72 97.8%
    2009
    • Red Hat 4, 2.6.9-78, Intel-Xeon 3.8GHz, 4 Gb Ram
    • HSqlDb 1.8.0.10
    9.512u 0.564s 0:10.22 98.5% 2022.738u 83.185s 37:43.68 93.0%
    2010
    • Red Hat 5.4, 2.6.18-164.6.1.el5, Intel-Xeon 3333MHz, 4 Gb Ram
    • HSqlDb 1.8.0.10
    9.829u 0.451s 0:09.83 104.4% 2276.579u 88.682s 39:19.78 100.2%
    2011
    • Red Hat 5.5, 2.6.18-194.8.1.el5, Intel-Xeon 3333MHz, 4 Gb Ram
    • HSqlDb 2.0.0
    9.802u 0.625s 1:43.15 10.1% 2575.986u 59.953s 43:00.67 102.1%
    2012
    • Red Hat 5.7, 2.6.18-274.7.1.el5, Intel-Xeon 3333MHz, 4 Gb Ram
    • HSqlDb 2.2.5
    10.071u 0.498s 1:02.48 16.9% 2612.924u 57.926s 43:45.37 101.7%
    2013 (lexlx1)
    • Red Hat Enterprise Linux Client release 5.5 (Tikanga), 2.6.18-308.13.1.el5, Intel-Xeon 3333MHz, 4 Gb Ram
    • HSqlDb 2.2.8
    9.440u 0.418s 0:07.24 136.0% 2410.561u 59.427s 40:15.56 102.2%
    2013 (lexdev)
    • Red Hat Enterprise Linux Workstation release 6.3 (Santiago), 16 Gb Ram
    • HSqlDb 2.2.8
    15.450u 0.928s 0:08.22 199.1% 3193.846u 91.376s 50:09.72 109.1%
    2014 (lexdev)
    • Red Hat Enterprise Linux Workstation release 6.4 (Santiago)
    • Intel(R) Xeon(R) CPU E5506 @ 2.13GHz, 16 Gb Ram
    • HSqlDb 2.3.0
    15.700u 0.965s 0:08.76 190.1% 3332.485u 86.613s 51:46.62 110.0%
    2015 (lexdev)
    • Red Hat Enterprise Linux Workstation release 6.5 (Santiago)
    • Intel(R) Xeon(R) CPU E5506 @ 2.13GHz, 48 Gb Ram
    • HSqlDb 2.3.2
    16.151u 0.747s 0:08.64 195.4% 3482.666u 93.574s 1:07:57.26 87.7%