validator/livr dev-master@abbe57e (PHP) fails LIVR test suite cases #33

Hi @WebbyLab!

The LIVR test suite was extended, and validator/livr dev-master@abbe57e fails some of its cases. This is not a regression in your release: the test suite became stricter and found bugs in the implementation that need fixing.

The test suite results of all implementations are published on the official LIVR site, livr-spec.org/introduction/implementations.html, and updated automatically every week and whenever the specification changes.

Failing cases

• negative/17-equal_to_field

  expected errors {"field1":"FIELDS_NOT_EQUAL","field2":"FIELDS_NOT_EQUAL","field3":"FIELDS_NOT_EQUAL","same_number_exponent":"FIELDS_NOT_EQUAL","same_number_leading_zero":"FIELDS_NOT_EQUAL","same_number_space":"FIELDS_NOT_EQUAL","missing_other_field":"FIELDS_NOT_EQUAL","value_is_hash":"FORMAT_ERROR","value_is_empty_..., got {"field1":"FIELDS_NOT_EQUAL","field2":"FIELDS_NOT_EQUAL","field3":"FIELDS_NOT_EQUAL","missing_other_field":"FIELDS_NOT_EQUAL","value_is_hash":"FORMAT_ERROR","value_is_empty_hash":"FORMAT_ERROR","value_is_array":"FORMAT_ERROR","value_is_empty_array":"FORMAT_ERROR"}
  

• negative/21-list_of_different_objects

  exception: TypeError: Cannot access offset of type array in isset or empty
  

• negative/28-variable_object

  exception: TypeError: Cannot access offset of type array in isset or empty
  

• negative/29-or

  expected errors {"id1-1":"NOT_POSITIVE_INTEGER","id2-1":"NOT_POSITIVE_INTEGER","id3-1":"WRONG_EMAIL","id4-1":"CANNOT_BE_EMPTY","id4-2":"REQUIRED","products":[{"name":"REQUIRED","product_type":"NOT_ALLOWED_VALUE"},{"name":"REQUIRED"}]}, got {"id1-1":"NOT_POSITIVE_INTEGER","id2-1":"NOT_POSITIVE_INTEGER","id3-1":"WRONG_EMAIL","products":[{"product_type":"NOT_ALLOWED_VALUE","name":"REQUIRED"},{"name":"REQUIRED"}]}
  

2 more cases fail for documented reasons (platform limitations) and aren't counted, see the test suite results.

How it was tested

conformance/php/ installs validator/livr dev-master@abbe57e from packagist the way a user would and runs every test suite case against it. conformance/run.sh php repeats the run locally (needs Docker).

Get the test suite

The cases are in the test_suite/ directory of the LIVR repository; the format is described in Test suite. To replace your copy with the current one, run this in the directory that contains it:

rm -rf test_suite
curl -fsSL https://github.com/koorchik/LIVR/archive/refs/heads/master.tar.gz | tar -xz --strip-components=1 LIVR-master/test_suite

What's next

This issue is updated after every test suite run and closes by itself once all cases pass. If you think a case is wrong, please comment here.

If validator/livr is no longer maintained, please open an issue to remove it from the implementations list on livr-spec.org.

_{Updated by the test suite run of koorchik/LIVR on 2026-10-23.}