Benchmarks: Round 0

The FHIR landscape is expanding and maturing rapidly. Users now have many great FHIR server implementation options to choose between. This project aims to help with those choices by reporting on the performance of FHIR server implementations.

This "Round 0" of the benchmarks is a preview of the eventual first round (which will be "Round 1"). The results captured here are generally transient; they'll be discarded/replaced regularly as the benchmarking tool evolves. In addition, the results will often be from runs that were against small datasets, for small numbers of iterations, and collected on "small" local development hardware. In other words: don't take these results too seriously.

These results were collected on 2021-05-02, with a target iteration count of 1000 and a sythetic population size of 1000.

Operation: metadata

Server Throughput Rank Failures Latency
HAPI FHIR JPA Server 98.7 0 9.55
Spark FHIR R4 Server 7.75 0 128.39

Operation: POST /Organization

Server Throughput Rank Failures Latency
HAPI FHIR JPA Server 7.54 0 131.73
Spark FHIR R4 Server 10.89 0 81.13