Error when creating ordering OPS

[arenas-guerrero-julian]

Hi, I am creating HDT dumps for WDbench. The library creates the HDT file for all orderings except for OPS (-disk -options triplesOrder=OPS) for which I get the following error:

[main][########  ] 80.00 Create bit triples: create triples
[main][########  ] 80.00 Create bit triples: Converting to BitmapTriples
[main][##########] 100.0 Clearing disk
Exception in thread "main" org.rdfhdt.hdt.exceptions.IllegalFormatException: Upper level must be increasing and correlative.
	at org.rdfhdt.hdt.triples.impl.WriteBitmapTriples.load(WriteBitmapTriples.java:190)
	at org.rdfhdt.hdt.hdt.impl.HDTDiskImporter.compressTriples(HDTDiskImporter.java:268)
	at org.rdfhdt.hdt.hdt.impl.HDTDiskImporter.runAllSteps(HDTDiskImporter.java:355)
	at org.rdfhdt.hdt.hdt.HDTManagerImpl.doGenerateHDTDisk0(HDTManagerImpl.java:300)
	at org.rdfhdt.hdt.hdt.HDTManagerImpl.doGenerateHDTDisk(HDTManagerImpl.java:265)
	at org.rdfhdt.hdt.hdt.HDTManagerImpl.doGenerateHDTDisk(HDTManagerImpl.java:253)
	at org.rdfhdt.hdt.hdt.HDTManager.generateHDTDisk(HDTManager.java:515)
	at org.rdfhdt.hdt.tools.RDF2HDT.execute(RDF2HDT.java:234)
	at org.rdfhdt.hdt.tools.RDF2HDT.main(RDF2HDT.java:344)

[ate47]

The triplesOrder option isn't really working, especially for the disk functions

[arenas-guerrero-julian]

For the other orderings (SPO, SOP, POS, PSO, OSP) it did work.

[ate47]

By not "really working" I mean that I didn't write any test to check if this part. So you technically have some code to do it, but nothing to guaranty it

[arenas-guerrero-julian]

When executed without -disk the error is:

Exception in thread "main" java.lang.OutOfMemoryError: Required array length 2147483639 + 70 is too large
	at java.base/jdk.internal.util.ArraysSupport.hugeLength(ArraysSupport.java:752)
	at java.base/jdk.internal.util.ArraysSupport.newLength(ArraysSupport.java:745)
	at java.base/java.io.ByteArrayOutputStream.ensureCapacity(ByteArrayOutputStream.java:100)
	at java.base/java.io.ByteArrayOutputStream.write(ByteArrayOutputStream.java:132)
	at org.rdfhdt.hdt.util.string.ByteStringUtil.append(ByteStringUtil.java:369)
	at org.rdfhdt.hdt.util.string.ByteStringUtil.append(ByteStringUtil.java:346)
	at org.rdfhdt.hdt.dictionary.impl.section.PFCDictionarySection.load(PFCDictionarySection.java:124)
	at org.rdfhdt.hdt.dictionary.impl.section.PFCDictionarySection.load(PFCDictionarySection.java:88)
	at org.rdfhdt.hdt.dictionary.impl.FourSectionDictionary.load(FourSectionDictionary.java:86)
	at org.rdfhdt.hdt.hdt.impl.HDTImpl.loadFromModifiableHDT(HDTImpl.java:360)
	at org.rdfhdt.hdt.hdt.HDTManagerImpl.doGenerateHDT(HDTManagerImpl.java:173)
	at org.rdfhdt.hdt.hdt.HDTManager.generateHDT(HDTManager.java:441)
	at org.rdfhdt.hdt.tools.RDF2HDT.execute(RDF2HDT.java:242)
	at org.rdfhdt.hdt.tools.RDF2HDT.main(RDF2HDT.java:344)