Java 序列化 ---性能比较
转载自：https://github.com/eishay/jvm-serializers.wiki.git
eishay/jvm-serializers
Test Platform
OS:Windows 8.1
JVM:Oracle Corporation 1.7.0_75
CPU:Intel64 Family 6 Model 60 Stepping 3, GenuineIntel os-arch:AMD64
Cores (incl HT):4
Disclaimer
This test focusses on en/decoding of a cyclefree datastructure, but the featureset of the libraries compared differs a lot:
- some serializers support cycle detection/object sharing others just write non-cyclic tree structures
- some include full metadata in serialized output, some don’t
- some are cross platform, some are language specific
- some are text based, some are binary,
- some support versioning forward/backward, both, some don’t
(See ToolBehavior)
Other test data will yield different results (e.g. adding a non ascii char toevery string :-) ). However the results give a raw estimation of libraryperformance.
Serializers (no shared refs)
Benchmarks serializers
- Only cycle free tree structures. An object referenced twice will be serialized twice.
- no manual optimizations.
- schema is known in advance (pre registration or even class generation). (Not all might make use of that)
Ser Time+Deser Time (ns)
Size, Compressed size [light] in bytes
create ser deser total size dfl
protostuff 438 2735 4154 6889 239 150
fst-flat-pre 332 4199 4234 8433 251 165
json/dsl-platform 290 3806 6013 9818 485 261
protobuf 690 6679 4100 10779 239 149
json/fastjson/databind 326 6295 6248 12543 486 262
msgpack/databind 331 4907 8190 13097 233 146
smile/jacksonafterburner/databind 318 5674 7443 13117 352 252
json-col/jackson/databind 325 5035 8213 13248 293 178
thrift 701 8492 4818 13311 349 197
cbor/jackson+afterburner/databind 321 5560 8662 14223 397 246
smile/jackson/databind 332 7047 9593 16641 338 241
scala/sbinary 2645 10418 6856 17274 255 147
json/jackson+afterburner/databind 333 6802 11738 18540 485 261
json/jackson-jr/databind 312 7257 12478 19735 468 255
xml/jackson/databind 304 15381 31919 47300 683 286
xml/xstream+c 339 33291 58579 91871 487 244
json/javax-tree/glassfish 6684 42814 62570 105384 485 263
xml/exi-manual 327 79439 83859 163298 337 327
java-built-in 354 30048 180401 210449 889 514
json/protobuf 700 38627 285788 324415 488 253
json/json-lib/databind 310 107977 786497 894474 485 263
Full Object Graph Serializers
Contains serializer(-configurations)
- supporting full object graph write/read. Object graph may contain cycles. If an Object is referenced twice, it will be so after deserialization.
- nothing is known in advance, no class generation, no preregistering of classes. Everything is captured at runtime using e.g. reflection.
- note this usually cannot be used cross language, however JSON/XML formats may enable cross language deserialization.
Ser Time+Deser Time (ns)
Size, Compressed size [light] in bytes
create ser deser total size +dfl
protostuff-graph 458 3567 4283 7851 239 150
protostuff-graph-runtime 373 4398 4745 9143 241 151
kryo-serializer 319 7996 7174 15170 286 188
fst 328 7062 8116 15179 316 203
jboss-marshalling-river-ct 375 14910 11937 26848 298 199
hessian 324 15564 30728 46292 501 313
jboss-marshalling-river 327 23039 116844 139884 694 400
stephenerialization 321 30420 128815 159234 1093 515
java-built-in-serializer 313 29427 143326 172752 889 514
jboss-serialization 320 85858 112995 198853 932 582
json/flexjson/databind 334 87989 147366 235355 503 273
Cross Lang Binary Serializers
Contains serializer(-configurations)
- Only cycle free tree structures. An object referenced twice will be serialized twice.
- schema is known in advance (pre registration, intermediate message description languages, class generation).
Ser Time+Deser Time (ns)
Size, Compressed size [light] in bytes
create ser deser total size +dfl
protobuf/protostuff 435 2636 4197 6833 239 149
protobuf/protostuff-runtime 314 3029 4099 7128 241 150
protobuf 690 6679 4100 10779 239 149
msgpack/databind 331 4907 8190 13097 233 146
thrift 701 8492 4818 13311 349 197
hessian 324 15564 30728 46292 501 313
XML/JSon Serializers
- text format based. Usually can be read by anybody. Frequently inline schema inside data.
- Mixed regarding required preparation, object graph awareness (references).
Ser Time+Deser Time (ns)
Size, Compressed size [light] in bytes
create ser deser total size dfl
json/dsl-platform 290 3806 6013 9818 485 261
json/fastjson/databind 326 6295 6248 12543 486 262
json-col/jackson/databind 325 5035 8213 13248 293 178
json/jackson-jr/databind 312 7257 12478 19735 468 255
xml/jackson/databind 304 15381 31919 47300 683 286
xml/xstreamc 339 33291 58579 91871 487 244
json/javax-tree/glassfish 6684 42814 62570 105384 485 263
xml/exi-manual 327 79439 83859 163298 337 327
json/flexjson/databind 334 87989 147366 235355 503 273
json/protobuf 700 38627 285788 324415 488 253
json/json-lib/databind 310 107977 786497 894474 485 263
Manually optimized Serializers
all flavours of manually optimized serializers. Handcodedand hardwired to exactly the benchmark’s message structures.
- illustrates what’s possible, at what level generic approaches can be optimized in case
Ser Time+Deser Time (ns)
Size, Compressed size [light] in bytes
create ser deser total size dfl
wobly 256 4291 2911 7202 251 151
kryo-opt 377 3002 4347 7349 209 129
wobly-compact 243 4725 3351 8077 225 139
smile/jackson/manual 319 4668 6268 10936 341 244
cbor/jackson/manual 324 4189 6812 11001 386 238
msgpack/manual 314 4768 7607 12375 233 146
json/jackson/manual 357 5407 8182 13589 468 253
jboss-marshalling-river-ct-manual 354 7956 6451 14407 289 167
avro-specific 453 8543 8016 16560 221 133
json/protostuff-manual 366 6643 11256 17899 449 233
xml/aalto-manual 323 10918 18308 29226 653 304
json/gson/manual 338 18940 18087 37027 468 253
xml/woodstox-manual 329 15340 24776 40116 653 304
json/json-smart/manual-tree 337 27752 21073 48825 495 269
bson/mongodb/manual 366 18296 36611 54907 495 278
json/gson/manual-tree 358 27796 27732 55528 485 259
xml/xstreamc-aalto 325 19228 40851 60079 525 273
xml/javolution/manual 308 24278 37427 61704 504 263
xml/xstream+c-fastinfo 351 34776 40057 74833 345 264
xml/xstream+c-woodstox 319 23171 55257 78427 525 273
json/org.json/manual-tree 297 33397 46017 79415 485 259
json/javax-stream/glassfish 361 30221 52407 82627 468 253
json/jsonij/manual-jpath 356 182909 72334 255243 478 258
Cost of features
shows performance vs convenience of manually-selected libs.
- cycle free, schema known at compile time, manual optimization: kryo-manual, msgpack/manual
- cycle free, schema known at compile time: protostuff, fst-flat-pre, kryo-flat-pre. (note: protostuff uses class generation while the other two just require a list of classes to be written)
- cycle free, schema UNKNOWN at compile time: fst-flat, kryo-flat, protostuff-runtime, msgpack/databind
- full object graph awareness, schema UNKNOWN at compile time: fst, kryo.
Ser Time+Deser Time (ns)
Size, Compressed size [light] in bytes
create ser deser total size +dfl
protostuff 438 2735 4154 6889 239 150
fst-flat-pre 332 4199 4234 8433 251 165
fst-flat 320 5130 6360 11490 314 204
msgpack/manual 314 4768 7607 12375 233 146
msgpack/databind 331 4907 8190 13097 233 146
kryo-serializer 319 7996 7174 15170 286 188
fst 328 7062 8116 15179 316 203
Full data
create ser deser total size +dfl
protobuf/protostuff 435 2636 4197 6833 239 149
protostuff 438 2735 4154 6889 239 150
protobuf/protostuff-runtime 314 3029 4099 7128 241 150
wobly 256 4291 2911 7202 251 151
kryo-opt 377 3002 4347 7349 209 129
protostuff-graph 458 3567 4283 7851 239 150
wobly-compact 243 4725 3351 8077 225 139
fst-flat-pre 332 4199 4234 8433 251 165
protostuff-graph-runtime 373 4398 4745 9143 241 151
json/dsl-platform 290 3806 6013 9818 485 261
protobuf 690 6679 4100 10779 239 149
smile/jackson/manual 319 4668 6268 10936 341 244
cbor/jackson/manual 324 4189 6812 11001 386 238
fst-flat 320 5130 6360 11490 314 204
msgpack/manual 314 4768 7607 12375 233 146
json/fastjson/databind 326 6295 6248 12543 486 262
msgpack/databind 331 4907 8190 13097 233 146
smile/jackson+afterburner/databind 318 5674 7443 13117 352 252
json-col/jackson/databind 325 5035 8213 13248 293 178
thrift 701 8492 4818 13311 349 197
json/jackson/manual 357 5407 8182 13589 468 253
cbor/jackson+afterburner/databind 321 5560 8662 14223 397 246
jboss-marshalling-river-ct-manual 354 7956 6451 14407 289 167
kryo-serializer 319 7996 7174 15170 286 188
fst 328 7062 8116 15179 316 203
avro-specific 453 8543 8016 16560 221 133
smile/jackson/databind 332 7047 9593 16641 338 241
scala/sbinary 2645 10418 6856 17274 255 147
json/protostuff-manual 366 6643 11256 17899 449 233
json/jackson+afterburner/databind 333 6802 11738 18540 485 261
json/jackson-jr/databind 312 7257 12478 19735 468 255
jboss-marshalling-river-ct 375 14910 11937 26848 298 199
xml/aalto-manual 323 10918 18308 29226 653 304
json/gson/manual 338 18940 18087 37027 468 253
xml/woodstox-manual 329 15340 24776 40116 653 304
hessian 324 15564 30728 46292 501 313
xml/jackson/databind 304 15381 31919 47300 683 286
json/json-smart/manual-tree 337 27752 21073 48825 495 269
bson/mongodb/manual 366 18296 36611 54907 495 278
json/gson/manual-tree 358 27796 27732 55528 485 259
xml/xstream+c-aalto 325 19228 40851 60079 525 273
xml/javolution/manual 308 24278 37427 61704 504 263
xml/xstream+c-fastinfo 351 34776 40057 74833 345 264
xml/xstream+c-woodstox 319 23171 55257 78427 525 273
json/org.json/manual-tree 297 33397 46017 79415 485 259
json/javax-stream/glassfish 361 30221 52407 82627 468 253
xml/xstream+c 339 33291 58579 91871 487 244
json/javax-tree/glassfish 6684 42814 62570 105384 485 263
jboss-marshalling-river 327 23039 116844 139884 694 400
stephenerialization 321 30420 128815 159234 1093 515
xml/exi-manual 327 79439 83859 163298 337 327
java-built-in-serializer 313 29427 143326 172752 889 514
jboss-serialization 320 85858 112995 198853 932 582
java-built-in 354 30048 180401 210449 889 514
json/flexjson/databind 334 87989 147366 235355 503 273
json/jsonij/manual-jpath 356 182909 72334 255243 478 258
json/protobuf 700 38627 285788 324415 488 253
json/json-lib/databind 310 107977 786497 894474 485 263
Effort Format Structure Misc
protobuf/protostuff CLASSES_KNOWN BIN_CROSSLANG FLAT_TREE [] protobuf + generated code
protostuff CLASSES_KNOWN BINARY FLAT_TREE [] generated code
protobuf/protostuff-runtime ZERO_KNOWLEDGE BIN_CROSSLANG FLAT_TREE [] protobuf + reflection
wobly MANUAL_OPT BINARY FLAT_TREE []
kryo-opt MANUAL_OPT BINARY FLAT_TREE [] manually optimized
protostuff-graph CLASSES_KNOWN BINARY FULL_GRAPH [] graph + generated code
wobly-compact MANUAL_OPT BINARY FLAT_TREE []
fst-flat-pre CLASSES_KNOWN BINARY FLAT_TREE [] fst in unshared mode with preregistered classes
protostuff-graph-runtime ZERO_KNOWLEDGE BINARY FULL_GRAPH [] graph + reflection
json/dsl-platform CLASSES_KNOWN JSON FLAT_TREE [] Serializes all properties.
protobuf CLASSES_KNOWN BIN_CROSSLANG FLAT_TREE []
smile/jackson/manual MANUAL_OPT BINARY FLAT_TREE []
cbor/jackson/manual MANUAL_OPT BIN_CROSSLANG FLAT_TREE []
fst-flat ZERO_KNOWLEDGE BINARY FLAT_TREE [] fst default, but unshared mode
msgpack/manual MANUAL_OPT BIN_CROSSLANG FLAT_TREE [] uses positional (column) layout (instead of Maps std impl uses) to eliminate use of names
json/fastjson/databind ZERO_KNOWLEDGE JSON FLAT_TREE []
msgpack/databind CLASSES_KNOWN BIN_CROSSLANG FLAT_TREE [] uses positional (column) layout (instead of Maps std impl uses) to eliminate use of names
smile/jackson+afterburner/databind ZERO_KNOWLEDGE BINARY FLAT_TREE [] uses bytecode generation to reduce overhead
json-col/jackson/databind ZERO_KNOWLEDGE JSON FLAT_TREE [] uses positional (column) layout to eliminate use of names
thrift CLASSES_KNOWN BIN_CROSSLANG FLAT_TREE []
json/jackson/manual MANUAL_OPT JSON FLAT_TREE []
cbor/jackson+afterburner/databind ZERO_KNOWLEDGE BINARY FLAT_TREE [] uses bytecode generation to reduce overhead
jboss-marshalling-river-ct-manual MANUAL_OPT BINARY FULL_GRAPH [] full graph preregistered classes, manual optimization
kryo-serializer ZERO_KNOWLEDGE BINARY FULL_GRAPH [] default
fst ZERO_KNOWLEDGE BINARY FULL_GRAPH [] default: JDK serialization drop-in-replacement mode
avro-specific MANUAL_OPT BIN_CROSSLANG UNKNOWN []
smile/jackson/databind ZERO_KNOWLEDGE BINARY FLAT_TREE []
scala/sbinary MISC MISC UNKNOWN [] null
json/protostuff-manual MANUAL_OPT JSON FLAT_TREE [] json + manual
json/jackson+afterburner/databind ZERO_KNOWLEDGE BINARY FLAT_TREE [] uses bytecode generation to reduce overhead
json/jackson-jr/databind ZERO_KNOWLEDGE JSON FLAT_TREE []
jboss-marshalling-river-ct CLASSES_KNOWN BINARY FULL_GRAPH [] full graph with preregistered classes
xml/aalto-manual MANUAL_OPT XML UNKNOWN []
json/gson/manual MANUAL_OPT JSON FLAT_TREE []
xml/woodstox-manual MANUAL_OPT XML UNKNOWN []
hessian ZERO_KNOWLEDGE BIN_CROSSLANG FULL_GRAPH []
xml/jackson/databind ZERO_KNOWLEDGE XML FLAT_TREE []
json/json-smart/manual-tree MANUAL_OPT JSON FLAT_TREE []
bson/mongodb/manual MANUAL_OPT BIN_CROSSLANG FLAT_TREE []
json/gson/manual-tree MANUAL_OPT JSON FLAT_TREE []
xml/xstream+c-aalto MANUAL_OPT XML FLAT_TREE []
xml/javolution/manual MANUAL_OPT XML FLAT_TREE []
xml/xstream+c-fastinfo MANUAL_OPT XML FLAT_TREE []
xml/xstream+c-woodstox MANUAL_OPT XML FLAT_TREE []
json/org.json/manual-tree MANUAL_OPT JSON FLAT_TREE []
json/javax-stream/glassfish MANUAL_OPT JSON FLAT_TREE []
xml/xstream+c ZERO_KNOWLEDGE XML FLAT_TREE []
json/javax-tree/glassfish ZERO_KNOWLEDGE JSON FLAT_TREE []
jboss-marshalling-river ZERO_KNOWLEDGE BINARY FULL_GRAPH [] full graph zero knowledge
stephenerialization ZERO_KNOWLEDGE BINARY FULL_GRAPH [] null
xml/exi-manual ZERO_KNOWLEDGE XML UNKNOWN []
java-built-in-serializer ZERO_KNOWLEDGE BINARY FULL_GRAPH []
jboss-serialization ZERO_KNOWLEDGE BINARY FULL_GRAPH []
java-built-in ZERO_KNOWLEDGE BINARY FLAT_TREE []
json/flexjson/databind ZERO_KNOWLEDGE JSON FULL_GRAPH []
json/jsonij/manual-jpath MANUAL_OPT JSON FLAT_TREE []
json/protobuf CLASSES_KNOWN JSON FLAT_TREE []
json/json-lib/databind ZERO_KNOWLEDGE JSON FLAT_TREE []