Is it reasonable to try to load billions of triples (20B+) to Corese?

[AndreaWesterinen]

I would like to experiment with the Wikidata RDF dump, but don't want to waste time if data this large (50G+) is not a target for Corese.

Thank you.

Andrea

[ocorby]

Hi, To my knowledge, 50G+ is too much. Best regards Olivier

…

De: "Andrea Westerinen" ***@***.***> À: "Wimmics/corese" ***@***.***> Cc: "Subscribed" ***@***.***> Envoyé: Lundi 28 Février 2022 22:48:47 Objet: [Wimmics/corese] Is it reasonable to try to load billions of triples (20B+) to Corese? (Discussion #95) I would like to experiment with the Wikidata RDF dump, but don't want to waste time if data this large (50G+) is not a target for Corese. Thank you. Andrea — Reply to this email directly, [ #95 | view it on GitHub ] , or [ https://github.com/notifications/unsubscribe-auth/ABKXNJABP3Z2GKADE3J24XDU5PUT7ANCNFSM5PSINXJA | unsubscribe ] . Triage notifications on the go with GitHub Mobile for [ https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 | iOS ] or [ https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub | Android ] . You are receiving this because you are subscribed to this thread. Message ID: ***@***.***>

[AndreaWesterinen]

Thanks. I could try to split the data load, and maybe split the triples across several stores, but each store would need to hold 10-15B triples.

Is that doable?
Andrea

[ocorby]

Hello, No, it will not work with B triples. It would work between 50M~100M triple depending on the memory. Best, Olivier

…

De: "Andrea Westerinen" ***@***.***> À: "Wimmics" ***@***.***> Cc: "Olivier Corby" ***@***.***>, "Comment" ***@***.***> Envoyé: Mardi 1 Mars 2022 16:36:44 Objet: Re: [Wimmics/corese] Is it reasonable to try to load billions of triples (20B+) to Corese? (Discussion #95) Thanks. I could try to split the data load, and maybe split the triples across several stores, but each store would need to hold 10-15B triples. Is that doable? Andrea — Reply to this email directly, [ #95 (reply in thread) | view it on GitHub ] , or [ https://github.com/notifications/unsubscribe-auth/ABKXNJGRDMWPJIKU7LOJCBTU5Y2QZANCNFSM5PSINXJA | unsubscribe ] . Triage notifications on the go with GitHub Mobile for [ https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 | iOS ] or [ https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub | Android ] . You are receiving this because you commented. Message ID: ***@***.***>