Add a test module benchmark case

[jviotti]

Signed-off-by: Juan Cruz Viotti jv@jviotti.com

[augmentcode]

🤖 Augment PR Summary

Summary: This PR adds benchmark coverage for the Blaze test module.

Changes:

• Registers `benchmark/test.cc` when `BLAZE_TEST` is enabled.
• Links the shared benchmark target against `sourcemeta::blaze::test`.
• Adds a benchmark that parses a WoT Thing Description test suite backed by a local schema fixture.
• Uses a resolver override for the WoT schema while delegating other identifiers to the standard resolver.

_{🤖 Was this summary useful? React with 👍 or 👎}

[augmentcode]

Review completed. No suggestions at this time.

Comment augment review to trigger a new review at any time.

[cubic-dev-ai]

No issues found across 2 files

_{Re-trigger cubic}

[github-actions]

Benchmark (macos/llvm)

Details

Benchmark suite	Current: a035912	Previous: 31d3723	Ratio
Schema_Iterator_ISO_Language	2155551.5295949304 ns/iter	2692405.6282056966 ns/iter	0.80
Schema_Tracker_ISO_Language	3033486.244019157 ns/iter	3634494.3369548987 ns/iter	0.83
Schema_Tracker_ISO_Language_To_JSON	13553182.581815483 ns/iter	17118902.45454387 ns/iter	0.79
Schema_Frame_WoT_References	4616478.74496655 ns/iter	6481099.600001644 ns/iter	0.71
Schema_Frame_OMC_References	20811484.05882767 ns/iter	25886833.333345294 ns/iter	0.80
Schema_Frame_OMC_Locations	19697744.028573133 ns/iter	21384937.500003316 ns/iter	0.92
Schema_Frame_ISO_Language_Locations	74292571.428584 ns/iter	82535687.5000125 ns/iter	0.90
Schema_Frame_KrakenD_References	41257687.49999281 ns/iter	51567427.0833036 ns/iter	0.80
Schema_Frame_KrakenD_Reachable	424910916.9999201 ns/iter	410184229.0001514 ns/iter	1.04
Schema_Frame_ISO_Language_Locations_To_JSON	67898852.27274019 ns/iter	74274954.20001832 ns/iter	0.91
Schema_Frame_Many_Resources_References	293914875.0000413 ns/iter	319097604.00003505 ns/iter	0.92
Schema_Bundle_Meta_2020_12	1258423.498137687 ns/iter	1353562.4126339136 ns/iter	0.93
Schema_Format_ISO_Language_To_JSON	77223254.55549455 ns/iter	87350505.12507313 ns/iter	0.88
E2E_Compiler_adaptivecard	55966217.923084445 ns/iter	64554795.4545691 ns/iter	0.87
E2E_Compiler_ansible_meta	30276745.535713546 ns/iter	34460632.9523837 ns/iter	0.88
E2E_Compiler_aws_cdk	256121.16919428145 ns/iter	354248.40625010204 ns/iter	0.72
E2E_Compiler_babelrc	2388234.8018874754 ns/iter	2164815.084967688 ns/iter	1.10
E2E_Compiler_clang_format	15778363.095239997 ns/iter	18540188.45454613 ns/iter	0.85
E2E_Compiler_cmake_presets	27294902.230769716 ns/iter	31995242.047612138 ns/iter	0.85
E2E_Compiler_code_climate	2962088.172535645 ns/iter	2533229.635338629 ns/iter	1.17
E2E_Compiler_cql2	12464588.45614079 ns/iter	11817935.096150206 ns/iter	1.05
E2E_Compiler_cspell	25482222.222215705 ns/iter	20422398.96969256 ns/iter	1.25
E2E_Compiler_cypress	3585150.7916666903 ns/iter	3469606.977529785 ns/iter	1.03
E2E_Compiler_deno	6753637.238531038 ns/iter	7053985.205606568 ns/iter	0.96
E2E_Compiler_dependabot	3864440.9518709187 ns/iter	3599008.5487169265 ns/iter	1.07
E2E_Compiler_draft_04	2629830.1886791596 ns/iter	2135538.5015202067 ns/iter	1.23
E2E_Compiler_fabric_mod	5668666.668789286 ns/iter	4516660.015956694 ns/iter	1.26
E2E_Compiler_geojson	24099066.333334394 ns/iter	27013755.964276243 ns/iter	0.89
E2E_Compiler_gitpod_configuration	4671535.11235895 ns/iter	4471067.982455269 ns/iter	1.04
E2E_Compiler_helm_chart_lock	616619.5347825545 ns/iter	557353.3184661743 ns/iter	1.11
E2E_Compiler_importmap	256036.82818343298 ns/iter	287017.0890936761 ns/iter	0.89
E2E_Compiler_jasmine	1263877.3817619684 ns/iter	1154482.8419118857 ns/iter	1.09
E2E_Compiler_jshintrc	3251223.0606062533 ns/iter	3355631.2669884614 ns/iter	0.97
E2E_Compiler_jsconfig	18483906.789469983 ns/iter	18699826.388885614 ns/iter	0.99
E2E_Compiler_krakend	131777008.40001306 ns/iter	150673750.00000992 ns/iter	0.87
E2E_Compiler_lazygit	36698003.77272994 ns/iter	32718664.66665025 ns/iter	1.12
E2E_Compiler_lerna	1271341.8003567087 ns/iter	1312355.1693403674 ns/iter	0.97
E2E_Compiler_nest_cli	7991083.330356983 ns/iter	6085839.217393107 ns/iter	1.31
E2E_Compiler_omc	177506448.00003102 ns/iter	216997572.75007415 ns/iter	0.82
E2E_Compiler_omnisharp	7023461.144230991 ns/iter	7904743.66304688 ns/iter	0.89
E2E_Compiler_openapi	25861776.04166551 ns/iter	22698330.25926952 ns/iter	1.14
E2E_Compiler_pre_commit_hooks	4905484.624162107 ns/iter	4418110.389611069 ns/iter	1.11
E2E_Compiler_pulumi	4774232.084999994 ns/iter	3212851.5904765837 ns/iter	1.49
E2E_Compiler_semantic_release	1365629.1483051185 ns/iter	1203131.5661476906 ns/iter	1.14
E2E_Compiler_stale	1135168.7828369911 ns/iter	1206712.2467768656 ns/iter	0.94
E2E_Compiler_stylecop	5187668.694445178 ns/iter	5382433.401638961 ns/iter	0.96
E2E_Compiler_tmuxinator	1504830.2469137523 ns/iter	1486536.3636369528 ns/iter	1.01
E2E_Compiler_ui5	48383349.3846165 ns/iter	49076069.41666624 ns/iter	0.99
E2E_Compiler_ui5_manifest	298054812.5000269 ns/iter	315024145.50004685 ns/iter	0.95
E2E_Compiler_unreal_engine_uproject	3687288.1578957327 ns/iter	3783423.8444449715 ns/iter	0.97
E2E_Compiler_users_array	679089.4668988475 ns/iter	702490.590336257 ns/iter	0.97
E2E_Compiler_vercel	9737840.791046044 ns/iter	13484023.385963315 ns/iter	0.72
E2E_Compiler_yamllint	227093.3711221891 ns/iter	312714.048408854 ns/iter	0.73
E2E_Evaluator_adaptivecard	18182.809453473386 ns/iter	19781.113415207765 ns/iter	0.92
E2E_Evaluator_ansible_meta	188524.196657714 ns/iter	191782.45075285906 ns/iter	0.98
E2E_Evaluator_aws_cdk	35154.098472447076 ns/iter	41367.19067821222 ns/iter	0.85
E2E_Evaluator_babelrc	88884.1778357524 ns/iter	95005.58827064265 ns/iter	0.94
E2E_Evaluator_cerebrum_criminal_case	928616.8986555786 ns/iter	803077.1027396435 ns/iter	1.16
E2E_Evaluator_clang_format	109331.79474396072 ns/iter	107461.6743098796 ns/iter	1.02
E2E_Evaluator_cmake_presets	4950480.082416956 ns/iter	3974074.704142394 ns/iter	1.25
E2E_Evaluator_code_climate	200028.64922527707 ns/iter	136556.60243018088 ns/iter	1.46
E2E_Evaluator_cql2	175625.38015312326 ns/iter	172256.06302518435 ns/iter	1.02
E2E_Evaluator_cspell	543583.291999994 ns/iter	503423.8962044329 ns/iter	1.08
E2E_Evaluator_cypress	159491.43815465362 ns/iter	185807.97303791885 ns/iter	0.86
E2E_Evaluator_deno	270614.37792640255 ns/iter	463749.90396762715 ns/iter	0.58
E2E_Evaluator_dependabot	283399.3988684243 ns/iter	342009.9058772008 ns/iter	0.83
E2E_Evaluator_draft_04	5866467.086956868 ns/iter	8420725.892156221 ns/iter	0.70
E2E_Evaluator_fabric_mod	631423.5586823304 ns/iter	670089.2576336905 ns/iter	0.94
E2E_Evaluator_geojson	10965415.620252248 ns/iter	11443349.400003303 ns/iter	0.96
E2E_Evaluator_gitpod_configuration	209576.23913685497 ns/iter	201588.6812412194 ns/iter	1.04
E2E_Evaluator_helm_chart_lock	310265.2902309037 ns/iter	303748.5698404307 ns/iter	1.02
E2E_Evaluator_importmap	42665.52053487066 ns/iter	51141.33981898951 ns/iter	0.83
E2E_Evaluator_jasmine	92047.25310409676 ns/iter	114386.98327194854 ns/iter	0.80
E2E_Evaluator_jshintrc	982869.9324325342 ns/iter	1152885.5657687422 ns/iter	0.85
E2E_Evaluator_jsconfig	308889.84239124256 ns/iter	363590.9669212414 ns/iter	0.85
E2E_Evaluator_krakend	150529.06982271004 ns/iter	163745.7272512494 ns/iter	0.92
E2E_Evaluator_lazygit	91065.63883377194 ns/iter	114362.27092201453 ns/iter	0.80
E2E_Evaluator_lerna	127099.9891564306 ns/iter	133026.17286096883 ns/iter	0.96
E2E_Evaluator_nest_cli	134194.58643120952 ns/iter	147586.56036444017 ns/iter	0.91
E2E_Evaluator_omc	20558.9528471119 ns/iter	15985.936297316293 ns/iter	1.29
E2E_Evaluator_omnisharp	559684.5410000242 ns/iter	477106.83188198606 ns/iter	1.17
E2E_Evaluator_openapi	10908878.086419698 ns/iter	9442333.328765988 ns/iter	1.16
E2E_Evaluator_pre_commit_hooks	382653.689171904 ns/iter	448087.04481788777 ns/iter	0.85
E2E_Evaluator_pulumi	744549.5409999694 ns/iter	649586.8599788839 ns/iter	1.15
E2E_Evaluator_semantic_release	91312.39516480135 ns/iter	76696.57066510717 ns/iter	1.19
E2E_Evaluator_stale	123120.1505110556 ns/iter	127862.47830927496 ns/iter	0.96
E2E_Evaluator_stylecop	200223.93909865204 ns/iter	216390.22072886748 ns/iter	0.93
E2E_Evaluator_tmuxinator	71475.90234252665 ns/iter	79144.5766181987 ns/iter	0.90
E2E_Evaluator_ui5	388585.9786536105 ns/iter	533920.4450041695 ns/iter	0.73
E2E_Evaluator_ui5_manifest	1658294.8924727829 ns/iter	2200322.852761376 ns/iter	0.75
E2E_Evaluator_unreal_engine_uproject	361900.246369571 ns/iter	371016.1909987826 ns/iter	0.98
E2E_Evaluator_users_array	435976.23387099395 ns/iter	487881.4404934211 ns/iter	0.89
E2E_Evaluator_vercel	267642.72353157826 ns/iter	303422.04152897286 ns/iter	0.88
E2E_Evaluator_yamllint	7376.840899088108 ns/iter	10188.12102374267 ns/iter	0.72
JSONLD_Catalog_Simple	27371671.499998648 ns/iter	22343038.043464217 ns/iter	1.23
JSONLD_Catalog_Override_Agreeing	19521934.51428294 ns/iter	23661841.41935939 ns/iter	0.83
JSONLD_Catalog_Override_Shadowing	26462945.962967515 ns/iter	30752846.043469615 ns/iter	0.86
Micro_Draft4_Meta_1_No_Callback	135.96997115577935 ns/iter	144.92165693413443 ns/iter	0.94
Micro_Draft4_Required_Properties	719.0674305764679 ns/iter	777.4521921535915 ns/iter	0.92
Micro_Draft4_Many_Optional_Properties_Minimal_Match	19.219228697985837 ns/iter	17.38457893592993 ns/iter	1.11
Micro_Draft4_Few_Optional_Properties_Minimal_Match	10.53974016784263 ns/iter	8.276559695383742 ns/iter	1.27
Micro_Draft4_Items_Schema	258.09296923740595 ns/iter	234.78684508620134 ns/iter	1.10
Micro_Draft4_Nested_Object	1.1350568254960556 ns/iter	1.0949813823746914 ns/iter	1.04
Micro_Draft4_Properties_Triad_Optional	238.35076892836216 ns/iter	231.12555381075256 ns/iter	1.03
Micro_Draft4_Properties_Triad_Closed	204.33176685121336 ns/iter	184.5456629130744 ns/iter	1.11
Micro_Draft4_Properties_Triad_Required	275.17968944389986 ns/iter	286.0563882731371 ns/iter	0.96
Micro_Draft4_Properties_Closed	62.03399490812883 ns/iter	61.151475059305525 ns/iter	1.01
Micro_Draft4_Non_Recursive_Ref	15.300589686191946 ns/iter	13.100080850591729 ns/iter	1.17
Micro_Draft4_Pattern_Properties_True	172.285472986434 ns/iter	158.46930814298008 ns/iter	1.09
Micro_Draft4_Ref_To_Single_Property	10.005111030030438 ns/iter	10.116161630172416 ns/iter	0.99
Micro_Draft4_Additional_Properties_Type	36.199164526572794 ns/iter	31.202785671987193 ns/iter	1.16
Micro_Draft4_Nested_Oneof	46.0517887962504 ns/iter	42.180697556027226 ns/iter	1.09
Micro_Draft4_Short_Enum	5.840158412898714 ns/iter	5.443549330020411 ns/iter	1.07
Micro_Draft4_Long_Enum	11.649140471281015 ns/iter	10.364842829892433 ns/iter	1.12
Micro_Draft4_Long_Enum_Short_Strings	8.238840992866614 ns/iter	6.96809295597088 ns/iter	1.18
Micro_Draft4_Type_Object	2.6499744596208283 ns/iter	2.523289047583252 ns/iter	1.05
Micro_Draft4_Ref_Single_100	1976823.7621618125 ns/iter	1888096.5147452455 ns/iter	1.05
Micro_Draft4_Compile_Ref_Many_Nested	1530986.3963036807 ns/iter	1289219.5338351547 ns/iter	1.19
Micro_Draft4_Compile_Wrap	2314299.147886705 ns/iter	2555409.1911772047 ns/iter	0.91
Micro_Draft6_Property_Names	101.58947389163104 ns/iter	112.15329498979023 ns/iter	0.91
Micro_Draft6_Compile_FHIR	12409388750.000061 ns/iter	15072728666.999865 ns/iter	0.82
Micro_Draft7_If_Then_Else	16.22579728237204 ns/iter	21.74844136346508 ns/iter	0.75
Micro_2019_09_Unevaluated_Properties	27.156070452948793 ns/iter	34.73331488452584 ns/iter	0.78
Micro_2019_09_Compile_Wrap	332917166.5000104 ns/iter	447785437.4999879 ns/iter	0.74
Micro_2020_12_Dynamic_Ref	646.0876065437253 ns/iter	715.7361672402426 ns/iter	0.90
Micro_2020_12_Dynamic_Ref_Single	2.339724580100918 ns/iter	3.1946809286991624 ns/iter	0.73
Micro_2020_12_Simple_Output_Mask	816.9866521607008 ns/iter	951.3627823308431 ns/iter	0.86
Micro_2020_12_Simple_Output_Annotations	60812.6894230911 ns/iter	69501.30575084304 ns/iter	0.87
Micro_2020_12_Simple_Output_Annotation_Dropping	1550842.643805622 ns/iter	1825721.599501622 ns/iter	0.85
Micro_2020_12_Compile_NonCircular_Shared_Refs	858541.6138364665 ns/iter	980394.5312497193 ns/iter	0.88
Micro_2020_12_Exhaustive_Deep_Numeric	5267.703750000692 ns/iter	5749.577945532664 ns/iter	0.92
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput	38111.62347719509 ns/iter	42871.38167896927 ns/iter	0.89
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput	13997.872256556724 ns/iter	15539.485982505472 ns/iter	0.90
Micro_2020_12_Exhaustive_Deep_Numeric_Fail	89.98309451235673 ns/iter	95.43007246769402 ns/iter	0.94
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput	3155.799563932322 ns/iter	3682.787007990815 ns/iter	0.86
TestSuite_Parse_WoT	39710113.4444458 ns/iter
Alterschema_Check_Readibility_ISO_Language_Set_3	225315764.0000154 ns/iter	235989485.99995613 ns/iter	0.95
Alterschema_Check_Readibility_OMC	62839799.27273074 ns/iter	71711800.00000277 ns/iter	0.88
Alterschema_Check_Readibility_KrakenD	717812459.0000153 ns/iter	808095417.000004 ns/iter	0.89
Alterschema_Apply_Readibility_KrakenD	84826378876.00026 ns/iter	98313429541.00046 ns/iter	0.86
Alterschema_Check_Invalid_External_Refs	180756239.49999908 ns/iter	177666666.74992847 ns/iter	1.02

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

JavaScript (macos/llvm)

Details

Benchmark suite	Current: a035912	Previous: 31d3723	Ratio
E2E_Evaluator_adaptivecard	137067 ns	100961 ns	1.36
E2E_Evaluator_ansible-meta	413155 ns	375432 ns	1.10
E2E_Evaluator_aws-cdk	153218 ns	117238 ns	1.31
E2E_Evaluator_babelrc	360828 ns	269060 ns	1.34
E2E_Evaluator_cerebrum-criminal-case	2152060 ns	1763111 ns	1.22
E2E_Evaluator_clang-format	226012 ns	230598 ns	0.98
E2E_Evaluator_cmake-presets	14138596 ns	17949536 ns	0.79
E2E_Evaluator_code-climate	462677 ns	493403 ns	0.94
E2E_Evaluator_cql2	1340835 ns	1266828 ns	1.06
E2E_Evaluator_cspell	1539951 ns	1637480 ns	0.94
E2E_Evaluator_cypress	800736 ns	756114 ns	1.06
E2E_Evaluator_deno	848743 ns	899857 ns	0.94
E2E_Evaluator_dependabot	784090 ns	798405 ns	0.98
E2E_Evaluator_draft-04	17977395 ns	15188753 ns	1.18
E2E_Evaluator_fabric-mod	1565774 ns	1500264 ns	1.04
E2E_Evaluator_geojson	16807654 ns	16870001 ns	1.00
E2E_Evaluator_gitpod-configuration	603569 ns	604790 ns	1.00
E2E_Evaluator_helm-chart-lock	974539 ns	856898 ns	1.14
E2E_Evaluator_importmap	295346 ns	221395 ns	1.33
E2E_Evaluator_jasmine	251108 ns	209755 ns	1.20
E2E_Evaluator_jsconfig	1318161 ns	908398 ns	1.45
E2E_Evaluator_jshintrc	2868661 ns	2078596 ns	1.38
E2E_Evaluator_krakend	565803 ns	529451 ns	1.07
E2E_Evaluator_lazygit	492684 ns	317087 ns	1.55
E2E_Evaluator_lerna	466522 ns	341094 ns	1.37
E2E_Evaluator_nest-cli	569505 ns	467913 ns	1.22
E2E_Evaluator_omc	118533 ns	98811 ns	1.20
E2E_Evaluator_omnisharp	1458886 ns	980781 ns	1.49
E2E_Evaluator_openapi	60100684 ns	30974030 ns	1.94
E2E_Evaluator_pre-commit-hooks	2269598 ns	1586412 ns	1.43
E2E_Evaluator_pulumi	2336856 ns	1432060 ns	1.63
E2E_Evaluator_semantic-release	328968 ns	192854 ns	1.71
E2E_Evaluator_stale	407499 ns	306013 ns	1.33
E2E_Evaluator_stylecop	1117340 ns	732241 ns	1.53
E2E_Evaluator_tmuxinator	243287 ns	213234 ns	1.14
E2E_Evaluator_ui5	2757008 ns	1901729 ns	1.45
E2E_Evaluator_ui5-manifest	11170774 ns	10375042 ns	1.08
E2E_Evaluator_unreal-engine-uproject	1400475 ns	1357403 ns	1.03
E2E_Evaluator_users-array	2877244 ns	2323243 ns	1.24
E2E_Evaluator_vercel	852906 ns	710553 ns	1.20
E2E_Evaluator_yamllint	33680 ns	23247 ns	1.45

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

Benchmark (linux/gcc)

Details

Benchmark suite	Current: a035912	Previous: 26e5116	Ratio
Alterschema_Check_Readibility_ISO_Language_Set_3	359770434.49997836 ns/iter	361549671.500029 ns/iter	1.00
Alterschema_Check_Readibility_OMC	103820944.85716413 ns/iter	104678945.0000298 ns/iter	0.99
Alterschema_Check_Readibility_KrakenD	1436907884.9999824 ns/iter	1446595580.000121 ns/iter	0.99
Alterschema_Apply_Readibility_KrakenD	136853876693.00008 ns/iter	148859225042.99994 ns/iter	0.92
Alterschema_Check_Invalid_External_Refs	284961187.0000217 ns/iter	299164260.9999872 ns/iter	0.95
TestSuite_Parse_WoT	49656138.92857488 ns/iter
Micro_2020_12_Dynamic_Ref	838.648119318715 ns/iter	842.7377832749415 ns/iter	1.00
Micro_2020_12_Dynamic_Ref_Single	5.487732330000199 ns/iter	4.925776202278419 ns/iter	1.11
Micro_2020_12_Simple_Output_Mask	1107.4153592673417 ns/iter	1096.9961006908775 ns/iter	1.01
Micro_2020_12_Simple_Output_Annotations	69803.75743105364 ns/iter	69615.29430379829 ns/iter	1.00
Micro_2020_12_Simple_Output_Annotation_Dropping	1807959.6735749196 ns/iter	1841754.421333462 ns/iter	0.98
Micro_2020_12_Compile_NonCircular_Shared_Refs	1067142.0351145086 ns/iter	1071501.115207173 ns/iter	1.00
Micro_2020_12_Exhaustive_Deep_Numeric	8898.385261985384 ns/iter	8816.24989045998 ns/iter	1.01
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput	52471.97825919562 ns/iter	51408.58732048915 ns/iter	1.02
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput	26521.940164800555 ns/iter	26756.111552878963 ns/iter	0.99
Micro_2020_12_Exhaustive_Deep_Numeric_Fail	159.3597974260526 ns/iter	159.36775750076905 ns/iter	1.00
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput	3047.692858858284 ns/iter	2974.008160164215 ns/iter	1.02
Micro_2019_09_Unevaluated_Properties	30.62228078889181 ns/iter	30.968982611760577 ns/iter	0.99
Micro_2019_09_Compile_Wrap	326179105.0000511 ns/iter	326312935.50002736 ns/iter	1.00
Micro_Draft7_If_Then_Else	25.30897277918141 ns/iter	25.23117930336724 ns/iter	1.00
Micro_Draft6_Property_Names	142.68452682124104 ns/iter	151.3663227385369 ns/iter	0.94
Micro_Draft6_Compile_FHIR	14990427424.000017 ns/iter	15160955231.999878 ns/iter	0.99
Micro_Draft4_Meta_1_No_Callback	180.81569488269656 ns/iter	181.1075661789262 ns/iter	1.00
Micro_Draft4_Required_Properties	912.9088386661375 ns/iter	893.5530691388808 ns/iter	1.02
Micro_Draft4_Many_Optional_Properties_Minimal_Match	21.922003895066517 ns/iter	21.855549240806603 ns/iter	1.00
Micro_Draft4_Few_Optional_Properties_Minimal_Match	15.837962169567511 ns/iter	16.174906880357398 ns/iter	0.98
Micro_Draft4_Items_Schema	319.18559091863483 ns/iter	307.9953850538067 ns/iter	1.04
Micro_Draft4_Nested_Object	2.1117755196342736 ns/iter	1.7619041808238574 ns/iter	1.20
Micro_Draft4_Properties_Triad_Optional	442.0076255091342 ns/iter	445.10311323327915 ns/iter	0.99
Micro_Draft4_Properties_Triad_Closed	395.8718876829248 ns/iter	346.9723634547503 ns/iter	1.14
Micro_Draft4_Properties_Triad_Required	489.8443108267477 ns/iter	508.1294389618541 ns/iter	0.96
Micro_Draft4_Properties_Closed	64.8597562894082 ns/iter	64.7687438771505 ns/iter	1.00
Micro_Draft4_Non_Recursive_Ref	9.186258335247679 ns/iter	8.454149372635591 ns/iter	1.09
Micro_Draft4_Pattern_Properties_True	191.8382320723971 ns/iter	200.05421549223968 ns/iter	0.96
Micro_Draft4_Ref_To_Single_Property	15.854023537675387 ns/iter	16.61344364658008 ns/iter	0.95
Micro_Draft4_Additional_Properties_Type	14.235689167085885 ns/iter	13.7195460518032 ns/iter	1.04
Micro_Draft4_Nested_Oneof	63.44318473328621 ns/iter	63.33311463339731 ns/iter	1.00
Micro_Draft4_Short_Enum	14.572129060397772 ns/iter	14.494088253352254 ns/iter	1.01
Micro_Draft4_Long_Enum	12.792355218549798 ns/iter	14.19889764877797 ns/iter	0.90
Micro_Draft4_Long_Enum_Short_Strings	14.543152423513911 ns/iter	14.463237116813138 ns/iter	1.01
Micro_Draft4_Type_Object	4.577268444025755 ns/iter	4.575212214783481 ns/iter	1.00
Micro_Draft4_Ref_Single_100	2423603.8551729005 ns/iter	2406278.496574979 ns/iter	1.01
Micro_Draft4_Compile_Ref_Many_Nested	1805763.9974293143 ns/iter	1774743.1746832987 ns/iter	1.02
Micro_Draft4_Compile_Wrap	2574777.639706587 ns/iter	2574301.147058791 ns/iter	1.00
JSONLD_Catalog_Simple	26737140.777775627 ns/iter	27134838.346158247 ns/iter	0.99
JSONLD_Catalog_Override_Agreeing	27990752.640007485 ns/iter	27990583.880000487 ns/iter	1.00
JSONLD_Catalog_Override_Shadowing	39590670.111111745 ns/iter	37455458.49999922 ns/iter	1.06
E2E_Compiler_adaptivecard	63973148.09090528 ns/iter	62611398.99999597 ns/iter	1.02
E2E_Compiler_ansible_meta	28656367.500000596 ns/iter	28971274.458333105 ns/iter	0.99
E2E_Compiler_aws_cdk	348848.7225260885 ns/iter	351155.23373373854 ns/iter	0.99
E2E_Compiler_babelrc	2519854.4352511005 ns/iter	2541505.6376808984 ns/iter	0.99
E2E_Compiler_clang_format	17621245.94999932 ns/iter	17778219.512820214 ns/iter	0.99
E2E_Compiler_cmake_presets	27180837.230765484 ns/iter	27142413.80768866 ns/iter	1.00
E2E_Compiler_code_climate	2539584.461818033 ns/iter	2570617.7132354258 ns/iter	0.99
E2E_Compiler_cql2	14069660.459999794 ns/iter	14169067.244897725 ns/iter	0.99
E2E_Compiler_cspell	23916958.58620457 ns/iter	23859193.172413517 ns/iter	1.00
E2E_Compiler_cypress	4149316.254438821 ns/iter	4083795.192981496 ns/iter	1.02
E2E_Compiler_deno	7995139.931818006 ns/iter	8064692.206896021 ns/iter	0.99
E2E_Compiler_dependabot	3818941.966481656 ns/iter	3887196.4088408393 ns/iter	0.98
E2E_Compiler_draft_04	2709307.28957517 ns/iter	2801508.8910508077 ns/iter	0.97
E2E_Compiler_fabric_mod	4630878.735098357 ns/iter	4677528.825504241 ns/iter	0.99
E2E_Compiler_geojson	22671845.000001755 ns/iter	22895166.322585635 ns/iter	0.99
E2E_Compiler_gitpod_configuration	4943158.380281691 ns/iter	5003393.121429716 ns/iter	0.99
E2E_Compiler_helm_chart_lock	643443.3412844914 ns/iter	648002.6958525251 ns/iter	0.99
E2E_Compiler_importmap	256163.67640614667 ns/iter	262663.9040328021 ns/iter	0.98
E2E_Compiler_jasmine	1324700.8071837435 ns/iter	1336824.9118775218 ns/iter	0.99
E2E_Compiler_jshintrc	4107524.594118171 ns/iter	4174224.1666665473 ns/iter	0.98
E2E_Compiler_jsconfig	21376022.545451414 ns/iter	21379183.636368413 ns/iter	1.00
E2E_Compiler_krakend	143101849.2000021 ns/iter	138601485.4000223 ns/iter	1.03
E2E_Compiler_lazygit	33049216.333340935 ns/iter	33464882.952373605 ns/iter	0.99
E2E_Compiler_lerna	1548931.7694015808 ns/iter	1569452.3856504501 ns/iter	0.99
E2E_Compiler_nest_cli	7305563.822915436 ns/iter	7327555.421053196 ns/iter	1.00
E2E_Compiler_omc	172132324.24995795 ns/iter	172126818.9999705 ns/iter	1.00
E2E_Compiler_omnisharp	6447042.345794173 ns/iter	6543211.196262789 ns/iter	0.99
E2E_Compiler_openapi	25973958.925929025 ns/iter	26395568.629629485 ns/iter	0.98
E2E_Compiler_pre_commit_hooks	5102931.554744038 ns/iter	5149406.801470659 ns/iter	0.99
E2E_Compiler_pulumi	3940376.8988753897 ns/iter	4001098.148571275 ns/iter	0.98
E2E_Compiler_semantic_release	1506314.4860216922 ns/iter	1533289.0327509556 ns/iter	0.98
E2E_Compiler_stale	1497960.884615296 ns/iter	1528907.013129121 ns/iter	0.98
E2E_Compiler_stylecop	5767876.421488896 ns/iter	5853102.932774584 ns/iter	0.99
E2E_Compiler_tmuxinator	1852243.6005295753 ns/iter	1884418.0748665945 ns/iter	0.98
E2E_Compiler_ui5	50861202.57141959 ns/iter	49747601.3571421 ns/iter	1.02
E2E_Compiler_ui5_manifest	332566787.00001884 ns/iter	339730961.4999813 ns/iter	0.98
E2E_Compiler_unreal_engine_uproject	4461513.076922785 ns/iter	4506047.384615077 ns/iter	0.99
E2E_Compiler_users_array	878601.5750001753 ns/iter	856940.3578429818 ns/iter	1.03
E2E_Compiler_vercel	13070519.18868054 ns/iter	12944753.111111352 ns/iter	1.01
E2E_Compiler_yamllint	328903.006046498 ns/iter	330115.02110694017 ns/iter	1.00
E2E_Evaluator_adaptivecard	25434.063062081907 ns/iter	25604.451886653296 ns/iter	0.99
E2E_Evaluator_ansible_meta	264550.06529080047 ns/iter	264301.3581640614 ns/iter	1.00
E2E_Evaluator_aws_cdk	56484.996691149136 ns/iter	56989.65823195117 ns/iter	0.99
E2E_Evaluator_babelrc	98746.55263897192 ns/iter	99715.55279592464 ns/iter	0.99
E2E_Evaluator_cerebrum_criminal_case	1200571.2713312046 ns/iter	1191103.2607205636 ns/iter	1.01
E2E_Evaluator_clang_format	97015.25391281143 ns/iter	102009.10026230132 ns/iter	0.95
E2E_Evaluator_cmake_presets	5291870.394161259 ns/iter	5130827.557521486 ns/iter	1.03
E2E_Evaluator_code_climate	200562.23374748975 ns/iter	204436.0266861858 ns/iter	0.98
E2E_Evaluator_cql2	213342.32992170702 ns/iter	212247.87053163827 ns/iter	1.01
E2E_Evaluator_cspell	582106.4403670841 ns/iter	569752.9260183579 ns/iter	1.02
E2E_Evaluator_cypress	153062.35406910293 ns/iter	156430.94829530732 ns/iter	0.98
E2E_Evaluator_deno	302987.60349351185 ns/iter	303883.3231234387 ns/iter	1.00
E2E_Evaluator_dependabot	358254.1905004743 ns/iter	364277.83669250505 ns/iter	0.98
E2E_Evaluator_draft_04	11927161.982757283 ns/iter	10750963.447761213 ns/iter	1.11
E2E_Evaluator_fabric_mod	771007.0813185826 ns/iter	767626.2327394456 ns/iter	1.00
E2E_Evaluator_geojson	20769245.75000305 ns/iter	19046475.555556852 ns/iter	1.09
E2E_Evaluator_gitpod_configuration	245793.5711311852 ns/iter	245140.1756757361 ns/iter	1.00
E2E_Evaluator_helm_chart_lock	225808.8669458373 ns/iter	223147.99805572283 ns/iter	1.01
E2E_Evaluator_importmap	39675.712269452895 ns/iter	41453.82121158682 ns/iter	0.96
E2E_Evaluator_jasmine	113857.5041659663 ns/iter	113614.98105874426 ns/iter	1.00
E2E_Evaluator_jshintrc	1049591.5105421082 ns/iter	1050777.722891424 ns/iter	1.00
E2E_Evaluator_jsconfig	418461.7019514117 ns/iter	415620.4078245015 ns/iter	1.01
E2E_Evaluator_krakend	196181.635437294 ns/iter	200367.0473338993 ns/iter	0.98
E2E_Evaluator_lazygit	136951.74932614432 ns/iter	131690.357644801 ns/iter	1.04
E2E_Evaluator_lerna	137695.18218298486 ns/iter	137004.47423288692 ns/iter	1.01
E2E_Evaluator_nest_cli	193979.80146849094 ns/iter	192572.09221427867 ns/iter	1.01
E2E_Evaluator_omc	22425.076812518877 ns/iter	22445.20365626706 ns/iter	1.00
E2E_Evaluator_omnisharp	539322.4284608281 ns/iter	537367.7607505465 ns/iter	1.00
E2E_Evaluator_openapi	18606319.333337575 ns/iter	19131576.621623173 ns/iter	0.97
E2E_Evaluator_pre_commit_hooks	490458.2120777568 ns/iter	495889.2245639721 ns/iter	0.99
E2E_Evaluator_pulumi	773869.2817371554 ns/iter	774821.7759196988 ns/iter	1.00
E2E_Evaluator_semantic_release	91612.95538642921 ns/iter	94523.99206979798 ns/iter	0.97
E2E_Evaluator_stale	172155.90095612925 ns/iter	171786.18154903513 ns/iter	1.00
E2E_Evaluator_stylecop	310787.14021171996 ns/iter	306580.66959571134 ns/iter	1.01
E2E_Evaluator_tmuxinator	96501.55260637836 ns/iter	97049.64636706968 ns/iter	0.99
E2E_Evaluator_ui5	571982.15176383 ns/iter	566940.663695367 ns/iter	1.01
E2E_Evaluator_ui5_manifest	2945072.676470199 ns/iter	2924656.609242898 ns/iter	1.01
E2E_Evaluator_unreal_engine_uproject	472866.53501018335 ns/iter	463573.1524634946 ns/iter	1.02
E2E_Evaluator_users_array	714526.0205974097 ns/iter	733742.0494736523 ns/iter	0.97
E2E_Evaluator_vercel	279781.66666663054 ns/iter	281413.5911270326 ns/iter	0.99
E2E_Evaluator_yamllint	11918.098734050865 ns/iter	12352.722955843294 ns/iter	0.96
Schema_Format_ISO_Language_To_JSON	117021729.50000052 ns/iter	112963751.33330609 ns/iter	1.04
Schema_Bundle_Meta_2020_12	1749247.4438906466 ns/iter	1752550.4962619501 ns/iter	1.00
Schema_Frame_WoT_References	5385990.860464841 ns/iter	5428054.5271312315 ns/iter	0.99
Schema_Frame_OMC_References	23614085.866665844 ns/iter	24124207.03448616 ns/iter	0.98
Schema_Frame_OMC_Locations	22497757.12500224 ns/iter	22034667.531251274 ns/iter	1.02
Schema_Frame_ISO_Language_Locations	105906702.42858584 ns/iter	103481465.14284703 ns/iter	1.02
Schema_Frame_KrakenD_References	42970306.062500186 ns/iter	41579330.76470834 ns/iter	1.03
Schema_Frame_KrakenD_Reachable	599928554.0001438 ns/iter	587262354.9998934 ns/iter	1.02
Schema_Frame_ISO_Language_Locations_To_JSON	136420923.00001425 ns/iter	129010616.59999868 ns/iter	1.06
Schema_Frame_Many_Resources_References	397099648.99998343 ns/iter	384580863.99998593 ns/iter	1.03
Schema_Iterator_ISO_Language	3769713.3208558643 ns/iter	4079946.881356488 ns/iter	0.92
Schema_Tracker_ISO_Language	5276433.692307154 ns/iter	5328403.398496283 ns/iter	0.99
Schema_Tracker_ISO_Language_To_JSON	20238827.057138614 ns/iter	20019330.628572006 ns/iter	1.01

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

JavaScript (linux/gcc)

Details

Benchmark suite	Current: a035912	Previous: 26e5116	Ratio
E2E_Evaluator_adaptivecard	119553 ns	117572 ns	1.02
E2E_Evaluator_ansible-meta	562432 ns	536595 ns	1.05
E2E_Evaluator_aws-cdk	132757 ns	133271 ns	1.00
E2E_Evaluator_babelrc	363700 ns	346464 ns	1.05
E2E_Evaluator_cerebrum-criminal-case	2727522 ns	2635828 ns	1.03
E2E_Evaluator_clang-format	268953 ns	251801 ns	1.07
E2E_Evaluator_cmake-presets	20807624 ns	19442422 ns	1.07
E2E_Evaluator_code-climate	534634 ns	524422 ns	1.02
E2E_Evaluator_cql2	1368854 ns	1343973 ns	1.02
E2E_Evaluator_cspell	1711074 ns	1720568 ns	0.99
E2E_Evaluator_cypress	895469 ns	892573 ns	1.00
E2E_Evaluator_deno	1151079 ns	1128139 ns	1.02
E2E_Evaluator_dependabot	1137187 ns	1123750 ns	1.01
E2E_Evaluator_draft-04	24934036 ns	24438107 ns	1.02
E2E_Evaluator_fabric-mod	2521956 ns	2503410 ns	1.01
E2E_Evaluator_geojson	26227141 ns	25426397 ns	1.03
E2E_Evaluator_gitpod-configuration	759172 ns	741002 ns	1.02
E2E_Evaluator_helm-chart-lock	1000898 ns	1007864 ns	0.99
E2E_Evaluator_importmap	274220 ns	268661 ns	1.02
E2E_Evaluator_jasmine	284259 ns	286199 ns	0.99
E2E_Evaluator_jsconfig	1593754 ns	1472207 ns	1.08
E2E_Evaluator_jshintrc	3019559 ns	2906337 ns	1.04
E2E_Evaluator_krakend	648119 ns	651197 ns	1.00
E2E_Evaluator_lazygit	494919 ns	459648 ns	1.08
E2E_Evaluator_lerna	460076 ns	442579 ns	1.04
E2E_Evaluator_nest-cli	642223 ns	611038 ns	1.05
E2E_Evaluator_omc	115807 ns	116140 ns	1.00
E2E_Evaluator_omnisharp	1555698 ns	1524535 ns	1.02
E2E_Evaluator_openapi	43543277 ns	42185637 ns	1.03
E2E_Evaluator_pre-commit-hooks	2117534 ns	2150687 ns	0.98
E2E_Evaluator_pulumi	2102042 ns	2048855 ns	1.03
E2E_Evaluator_semantic-release	233596 ns	231520 ns	1.01
E2E_Evaluator_stale	398907 ns	385906 ns	1.03
E2E_Evaluator_stylecop	1187715 ns	1156783 ns	1.03
E2E_Evaluator_tmuxinator	232346 ns	226052 ns	1.03
E2E_Evaluator_ui5	2300626 ns	2214395 ns	1.04
E2E_Evaluator_ui5-manifest	10926715 ns	11212340 ns	0.97
E2E_Evaluator_unreal-engine-uproject	1668224 ns	1581935 ns	1.05
E2E_Evaluator_users-array	2816402 ns	2830653 ns	0.99
E2E_Evaluator_vercel	1033802 ns	999592 ns	1.03
E2E_Evaluator_yamllint	24764 ns	24025 ns	1.03

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

Benchmark (linux/llvm)

Details

Benchmark suite	Current: a035912	Previous: 33c3ad0	Ratio
Schema_Iterator_ISO_Language	2893136.8042544527 ns/iter	2926367.30472127 ns/iter	0.99
Schema_Tracker_ISO_Language	4585989.908497628 ns/iter	4566563.039215788 ns/iter	1.00
Schema_Tracker_ISO_Language_To_JSON	21286844.12121567 ns/iter	20891775.272730228 ns/iter	1.02
Schema_Frame_WoT_References	4643570.17999949 ns/iter	4504939.1225802535 ns/iter	1.03
Schema_Frame_OMC_References	19620486.27777651 ns/iter	19270836.19444324 ns/iter	1.02
Schema_Frame_OMC_Locations	18169294.13157715 ns/iter	17864890.225001775 ns/iter	1.02
Schema_Frame_ISO_Language_Locations	97096662.83333717 ns/iter	96880521.71428093 ns/iter	1.00
Schema_Frame_KrakenD_References	37189756.684208415 ns/iter	36370407.47369275 ns/iter	1.02
Schema_Frame_KrakenD_Reachable	550040564.9997902 ns/iter	548631103.9999237 ns/iter	1.00
Schema_Frame_ISO_Language_Locations_To_JSON	116351555.39997868 ns/iter	115390725.79998901 ns/iter	1.01
Schema_Frame_Many_Resources_References	350066014.5000438 ns/iter	347981299.5000202 ns/iter	1.01
Schema_Bundle_Meta_2020_12	1478650.4324953242 ns/iter	1458489.337505379 ns/iter	1.01
Schema_Format_ISO_Language_To_JSON	105394865.28568886 ns/iter	103378367.57142733 ns/iter	1.02
E2E_Compiler_adaptivecard	57601838.49999597 ns/iter	57138504.000004806 ns/iter	1.01
E2E_Compiler_ansible_meta	25341687.500006825 ns/iter	25039020.857142143 ns/iter	1.01
E2E_Compiler_aws_cdk	334859.90756705817 ns/iter	323474.2095062284 ns/iter	1.04
E2E_Compiler_babelrc	2345253.765886134 ns/iter	2300782.2499996684 ns/iter	1.02
E2E_Compiler_clang_format	16437475.604651662 ns/iter	16274580.813953519 ns/iter	1.01
E2E_Compiler_cmake_presets	25191048.749994546 ns/iter	24962306.428571016 ns/iter	1.01
E2E_Compiler_code_climate	2343877.585284353 ns/iter	2303073.8782897457 ns/iter	1.02
E2E_Compiler_cql2	12861636.181816556 ns/iter	12767077.781820098 ns/iter	1.01
E2E_Compiler_cspell	22579177.61290452 ns/iter	22340480.258061424 ns/iter	1.01
E2E_Compiler_cypress	3908130.0055866386 ns/iter	3905782.833333483 ns/iter	1.00
E2E_Compiler_deno	7135324.734695225 ns/iter	7001639.4100002805 ns/iter	1.02
E2E_Compiler_dependabot	3543520.7461938113 ns/iter	3505887.244999713 ns/iter	1.01
E2E_Compiler_draft_04	2465141.3908449747 ns/iter	2422122.70242241 ns/iter	1.02
E2E_Compiler_fabric_mod	4301609.055213971 ns/iter	4235117.242423615 ns/iter	1.02
E2E_Compiler_geojson	20251807.085709777 ns/iter	19974468.285714205 ns/iter	1.01
E2E_Compiler_gitpod_configuration	4560517.551948425 ns/iter	4485931.403847551 ns/iter	1.02
E2E_Compiler_helm_chart_lock	631241.3942395005 ns/iter	623291.729443036 ns/iter	1.01
E2E_Compiler_importmap	250303.34894524905 ns/iter	244393.51066058376 ns/iter	1.02
E2E_Compiler_jasmine	1236854.2978724174 ns/iter	1221932.3350786297 ns/iter	1.01
E2E_Compiler_jshintrc	3907867.853932361 ns/iter	3854102.6153842434 ns/iter	1.01
E2E_Compiler_jsconfig	20206457.771428175 ns/iter	20042647.17143087 ns/iter	1.01
E2E_Compiler_krakend	134846995.99998748 ns/iter	133916769.79999828 ns/iter	1.01
E2E_Compiler_lazygit	30454892.565221995 ns/iter	30038239.434786547 ns/iter	1.01
E2E_Compiler_lerna	1457666.8079333329 ns/iter	1430901.0224951261 ns/iter	1.02
E2E_Compiler_nest_cli	6769387.259614983 ns/iter	6656641.009434902 ns/iter	1.02
E2E_Compiler_omc	150568166.19999152 ns/iter	155460231.79999793 ns/iter	0.97
E2E_Compiler_omnisharp	6073734.878260518 ns/iter	5974304.405171928 ns/iter	1.02
E2E_Compiler_openapi	23247918.266664173 ns/iter	22841778.548391014 ns/iter	1.02
E2E_Compiler_pre_commit_hooks	4772112.659864644 ns/iter	4656465.880001027 ns/iter	1.02
E2E_Compiler_pulumi	3685970.8324602675 ns/iter	3600298.4536082163 ns/iter	1.02
E2E_Compiler_semantic_release	1399320.2399997243 ns/iter	1374090.3602359956 ns/iter	1.02
E2E_Compiler_stale	1419609.0447153142 ns/iter	1402186.3757455791 ns/iter	1.01
E2E_Compiler_stylecop	5304279.931818435 ns/iter	5234354.559702093 ns/iter	1.01
E2E_Compiler_tmuxinator	1723168.9047614674 ns/iter	1690893.3623187034 ns/iter	1.02
E2E_Compiler_ui5	46126720.93332245 ns/iter	45732598.60000386 ns/iter	1.01
E2E_Compiler_ui5_manifest	301582724.00001353 ns/iter	308301360.9999625 ns/iter	0.98
E2E_Compiler_unreal_engine_uproject	4183390.461078973 ns/iter	4093513.928571231 ns/iter	1.02
E2E_Compiler_users_array	786919.174943589 ns/iter	779939.1486031959 ns/iter	1.01
E2E_Compiler_vercel	12103792.241379684 ns/iter	11964937.474577723 ns/iter	1.01
E2E_Compiler_yamllint	312003.45365422114 ns/iter	303940.3418543444 ns/iter	1.03
E2E_Evaluator_adaptivecard	25538.956902556725 ns/iter	25721.395118349334 ns/iter	0.99
E2E_Evaluator_ansible_meta	241861.31553057453 ns/iter	246475.14054815943 ns/iter	0.98
E2E_Evaluator_aws_cdk	54088.952201362394 ns/iter	53490.476971416436 ns/iter	1.01
E2E_Evaluator_babelrc	115240.1299686775 ns/iter	116615.63772453615 ns/iter	0.99
E2E_Evaluator_cerebrum_criminal_case	1029275.0941178999 ns/iter	1034129.3185185215 ns/iter	1.00
E2E_Evaluator_clang_format	119807.61280955255 ns/iter	120153.13559319814 ns/iter	1.00
E2E_Evaluator_cmake_presets	4344652.111111502 ns/iter	4712302.54666807 ns/iter	0.92
E2E_Evaluator_code_climate	184963.00633581122 ns/iter	184036.73636605724 ns/iter	1.01
E2E_Evaluator_cql2	212827.29126212295 ns/iter	217451.07977739576 ns/iter	0.98
E2E_Evaluator_cspell	636829.2938967783 ns/iter	649850.9527856299 ns/iter	0.98
E2E_Evaluator_cypress	200296.32704405527 ns/iter	199566.54339082513 ns/iter	1.00
E2E_Evaluator_deno	328658.29662254493 ns/iter	338469.0878962849 ns/iter	0.97
E2E_Evaluator_dependabot	386731.1173103695 ns/iter	337527.2395181358 ns/iter	1.15
E2E_Evaluator_draft_04	8821252.012986796 ns/iter	9079936.041669296 ns/iter	0.97
E2E_Evaluator_fabric_mod	726070.8633166634 ns/iter	718906.4391752123 ns/iter	1.01
E2E_Evaluator_geojson	16321226.30952554 ns/iter	16211214.534884442 ns/iter	1.01
E2E_Evaluator_gitpod_configuration	251785.47058825195 ns/iter	254206.9569185692 ns/iter	0.99
E2E_Evaluator_helm_chart_lock	323610.1179723964 ns/iter	324787.4337016139 ns/iter	1.00
E2E_Evaluator_importmap	51734.023315680664 ns/iter	50265.98953929099 ns/iter	1.03
E2E_Evaluator_jasmine	109980.31443782878 ns/iter	110273.89893117185 ns/iter	1.00
E2E_Evaluator_jshintrc	1223004.3763066733 ns/iter	1218348.360139857 ns/iter	1.00
E2E_Evaluator_jsconfig	437571.3881909658 ns/iter	440240.85651349486 ns/iter	0.99
E2E_Evaluator_krakend	216571.84627234007 ns/iter	215624.2125195651 ns/iter	1.00
E2E_Evaluator_lazygit	155854.16512145038 ns/iter	153083.225841941 ns/iter	1.02
E2E_Evaluator_lerna	145462.23365462746 ns/iter	148699.7343618186 ns/iter	0.98
E2E_Evaluator_nest_cli	194039.81560479334 ns/iter	192680.17106002299 ns/iter	1.01
E2E_Evaluator_omc	21877.457966945465 ns/iter	22278.514718466537 ns/iter	0.98
E2E_Evaluator_omnisharp	624768.3712256392 ns/iter	621461.0044169718 ns/iter	1.01
E2E_Evaluator_openapi	14366788.042552605 ns/iter	15188074.044443864 ns/iter	0.95
E2E_Evaluator_pre_commit_hooks	511642.5120880297 ns/iter	521249.5846267393 ns/iter	0.98
E2E_Evaluator_pulumi	685056.9912622075 ns/iter	689453.5113077423 ns/iter	0.99
E2E_Evaluator_semantic_release	103120.51992465144 ns/iter	103298.71096151276 ns/iter	1.00
E2E_Evaluator_stale	156508.43029762217 ns/iter	159118.37445935904 ns/iter	0.98
E2E_Evaluator_stylecop	309779.72551606596 ns/iter	302153.3496257749 ns/iter	1.03
E2E_Evaluator_tmuxinator	100581.08849557207 ns/iter	100941.46451331317 ns/iter	1.00
E2E_Evaluator_ui5	527926.7783702441 ns/iter	529525.0272162477 ns/iter	1.00
E2E_Evaluator_ui5_manifest	2579889.955555464 ns/iter	2626544.4160306305 ns/iter	0.98
E2E_Evaluator_unreal_engine_uproject	456306.6692758976 ns/iter	454728.04193547834 ns/iter	1.00
E2E_Evaluator_users_array	578280.0583333862 ns/iter	590538.1786015941 ns/iter	0.98
E2E_Evaluator_vercel	323450.6780443501 ns/iter	323025.9436228563 ns/iter	1.00
E2E_Evaluator_yamllint	9313.507140935122 ns/iter	9437.792220037598 ns/iter	0.99
JSONLD_Catalog_Simple	24847408.821423348 ns/iter	25803520.82142261 ns/iter	0.96
JSONLD_Catalog_Override_Agreeing	25525373.178571243 ns/iter	26108869.32142518 ns/iter	0.98
JSONLD_Catalog_Override_Shadowing	36641910.57894066 ns/iter	37687328.89474641 ns/iter	0.97
Micro_Draft4_Meta_1_No_Callback	195.1944709529931 ns/iter	205.5183649094742 ns/iter	0.95
Micro_Draft4_Required_Properties	910.9121585316242 ns/iter	893.9817821065997 ns/iter	1.02
Micro_Draft4_Many_Optional_Properties_Minimal_Match	23.31930754600151 ns/iter	23.16701985196419 ns/iter	1.01
Micro_Draft4_Few_Optional_Properties_Minimal_Match	12.157914095824443 ns/iter	12.152312645880674 ns/iter	1.00
Micro_Draft4_Items_Schema	279.8531278689063 ns/iter	280.68129995343685 ns/iter	1.00
Micro_Draft4_Nested_Object	1.8306241657221134 ns/iter	1.8383762463856588 ns/iter	1.00
Micro_Draft4_Properties_Triad_Optional	325.17870312185175 ns/iter	323.28764524156225 ns/iter	1.01
Micro_Draft4_Properties_Triad_Closed	268.18572481455715 ns/iter	267.6057673533586 ns/iter	1.00
Micro_Draft4_Properties_Triad_Required	347.6625552534651 ns/iter	347.5955197891747 ns/iter	1.00
Micro_Draft4_Properties_Closed	59.31116987456086 ns/iter	59.7353457720372 ns/iter	0.99
Micro_Draft4_Non_Recursive_Ref	14.37113015559201 ns/iter	14.502366435759292 ns/iter	0.99
Micro_Draft4_Pattern_Properties_True	152.0473595735255 ns/iter	152.06779445394037 ns/iter	1.00
Micro_Draft4_Ref_To_Single_Property	12.151310276791735 ns/iter	12.170556030200741 ns/iter	1.00
Micro_Draft4_Additional_Properties_Type	33.29489696706876 ns/iter	33.30166169848023 ns/iter	1.00
Micro_Draft4_Nested_Oneof	57.63500895901853 ns/iter	57.58376115313549 ns/iter	1.00
Micro_Draft4_Short_Enum	9.975703083216416 ns/iter	9.973378839640061 ns/iter	1.00
Micro_Draft4_Long_Enum	14.342337503745494 ns/iter	14.35146396905173 ns/iter	1.00
Micro_Draft4_Long_Enum_Short_Strings	9.98128040781827 ns/iter	9.975565939032407 ns/iter	1.00
Micro_Draft4_Type_Object	3.428646639926269 ns/iter	3.4275497359711236 ns/iter	1.00
Micro_Draft4_Ref_Single_100	2360874.847972901 ns/iter	2329721.690000497 ns/iter	1.01
Micro_Draft4_Compile_Ref_Many_Nested	1712667.198043873 ns/iter	1688227.830917956 ns/iter	1.01
Micro_Draft4_Compile_Wrap	2340348.996632976 ns/iter	2314272.5460527763 ns/iter	1.01
Micro_Draft6_Property_Names	118.22864891769174 ns/iter	119.89511892393348 ns/iter	0.99
Micro_Draft6_Compile_FHIR	13429431007.999937 ns/iter	13291250221.999916 ns/iter	1.01
Micro_Draft7_If_Then_Else	22.40900675583633 ns/iter	22.443123055605156 ns/iter	1.00
Micro_2019_09_Unevaluated_Properties	26.800434971770756 ns/iter	26.806986637607224 ns/iter	1.00
Micro_2019_09_Compile_Wrap	290671813.5000119 ns/iter	278607574.333364 ns/iter	1.04
Micro_2020_12_Dynamic_Ref	708.2409133604338 ns/iter	704.7945331266162 ns/iter	1.00
Micro_2020_12_Dynamic_Ref_Single	3.4277429361286877 ns/iter	3.4305890289834133 ns/iter	1.00
Micro_2020_12_Simple_Output_Mask	1062.3918831977937 ns/iter	1069.2925871028708 ns/iter	0.99
Micro_2020_12_Simple_Output_Annotations	68014.7001873059 ns/iter	69111.30193714649 ns/iter	0.98
Micro_2020_12_Simple_Output_Annotation_Dropping	1663856.3420428368 ns/iter	1651190.117924353 ns/iter	1.01
Micro_2020_12_Compile_NonCircular_Shared_Refs	995552.4275569096 ns/iter	976740.9971951427 ns/iter	1.02
Micro_2020_12_Exhaustive_Deep_Numeric	8411.096814685663 ns/iter	8747.415971097687 ns/iter	0.96
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput	46388.3273006288 ns/iter	44387.586877961556 ns/iter	1.05
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput	22838.456681350955 ns/iter	22900.287456276306 ns/iter	1.00
Micro_2020_12_Exhaustive_Deep_Numeric_Fail	149.2552440295496 ns/iter	151.55428691722452 ns/iter	0.98
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput	2915.2451548901563 ns/iter	2776.0176152724584 ns/iter	1.05
TestSuite_Parse_WoT	45035223.499994 ns/iter	44379603.999999516 ns/iter	1.01
Alterschema_Check_Readibility_ISO_Language_Set_3	356520264.9999719 ns/iter	357992033.4999542 ns/iter	1.00
Alterschema_Check_Readibility_OMC	83805531.87501505 ns/iter	83462247.87499069 ns/iter	1.00
Alterschema_Check_Readibility_KrakenD	1160939363.000125 ns/iter	1156339056.0002062 ns/iter	1.00
Alterschema_Apply_Readibility_KrakenD	117432073166.00024 ns/iter	116731434122.0001 ns/iter	1.01
Alterschema_Check_Invalid_External_Refs	300725510.5000013 ns/iter	297632297.4999448 ns/iter	1.01

This comment was automatically generated by workflow using github-action-benchmark.

[github-actions]

JavaScript (linux/llvm)

Details

Benchmark suite	Current: a035912	Previous: 33c3ad0	Ratio
E2E_Evaluator_adaptivecard	119033 ns	120396 ns	0.99
E2E_Evaluator_ansible-meta	527971 ns	517937 ns	1.02
E2E_Evaluator_aws-cdk	155914 ns	148755 ns	1.05
E2E_Evaluator_babelrc	341506 ns	332177 ns	1.03
E2E_Evaluator_cerebrum-criminal-case	2505922 ns	2432333 ns	1.03
E2E_Evaluator_clang-format	261003 ns	255591 ns	1.02
E2E_Evaluator_cmake-presets	21323249 ns	18184259 ns	1.17
E2E_Evaluator_code-climate	530736 ns	526487 ns	1.01
E2E_Evaluator_cql2	1291310 ns	1274960 ns	1.01
E2E_Evaluator_cspell	1534036 ns	1488677 ns	1.03
E2E_Evaluator_cypress	773531 ns	757635 ns	1.02
E2E_Evaluator_deno	1068037 ns	1046891 ns	1.02
E2E_Evaluator_dependabot	1145969 ns	1112660 ns	1.03
E2E_Evaluator_draft-04	20998522 ns	22305123 ns	0.94
E2E_Evaluator_fabric-mod	2345797 ns	2326560 ns	1.01
E2E_Evaluator_geojson	22311089 ns	24734222 ns	0.90
E2E_Evaluator_gitpod-configuration	713900 ns	702180 ns	1.02
E2E_Evaluator_helm-chart-lock	996924 ns	1039534 ns	0.96
E2E_Evaluator_importmap	278047 ns	266580 ns	1.04
E2E_Evaluator_jasmine	289427 ns	295431 ns	0.98
E2E_Evaluator_jsconfig	1224939 ns	1233948 ns	0.99
E2E_Evaluator_jshintrc	2718455 ns	2708688 ns	1.00
E2E_Evaluator_krakend	683475 ns	669966 ns	1.02
E2E_Evaluator_lazygit	511107 ns	501303 ns	1.02
E2E_Evaluator_lerna	458917 ns	460524 ns	1.00
E2E_Evaluator_nest-cli	586225 ns	584273 ns	1.00
E2E_Evaluator_omc	116691 ns	122939 ns	0.95
E2E_Evaluator_omnisharp	1391651 ns	1367603 ns	1.02
E2E_Evaluator_openapi	42940542 ns	42546429 ns	1.01
E2E_Evaluator_pre-commit-hooks	1957518 ns	1964651 ns	1.00
E2E_Evaluator_pulumi	1902754 ns	1882994 ns	1.01
E2E_Evaluator_semantic-release	251967 ns	257197 ns	0.98
E2E_Evaluator_stale	401729 ns	409782 ns	0.98
E2E_Evaluator_stylecop	1151536 ns	1191598 ns	0.97
E2E_Evaluator_tmuxinator	223321 ns	225457 ns	0.99
E2E_Evaluator_ui5	2229286 ns	2220210 ns	1.00
E2E_Evaluator_ui5-manifest	10138043 ns	11014023 ns	0.92
E2E_Evaluator_unreal-engine-uproject	1499168 ns	1505521 ns	1.00
E2E_Evaluator_users-array	3033499 ns	3064284 ns	0.99
E2E_Evaluator_vercel	959281 ns	971971 ns	0.99
E2E_Evaluator_yamllint	25389 ns	25665 ns	0.99

This comment was automatically generated by workflow using github-action-benchmark.