Database improvement structure

[jorgebenzeno]

Your mongodb model looks like this

`export interface DatabaseDocDataQualifiers {
[key: string]: string;
}

export interface DatabaseDocData {
qualifiers: DatabaseDocDataQualifiers[];
linkset: Linkset[];
}

export interface DatabaseDoc {
_id: string;
defaultLinktype: string;
data: DatabaseDocData[];
}

export interface DatabaseDocEntity extends DatabaseDoc {
}`

If a company use your system for almost more than 1 years and creates 1 million digital links all using the same GTIN and changing the serial number then your mongodb will contains only 1 entry and a million of data in the DatabaseDoc.data.

If that rigth! The resolver will take O(1M), so it will make 1M iterations each time it wants to resolve a digital link.

The mongodb structure should be differente for improving resovler performace?

for a entry lke this

[ { "anchor": "/01/09780345418913", "itemDescription": "Dal Giardino Risotto Rice with Mushrooms 411 gr", "defaultLinktype": "gs1:sustainabilityInfo", "qualifiers": [ { "21": "0001" } ], "links": [ { "linktype": "gs1:hasRetailers", "href": "https://dalgiardino.com/where-to-buy/?test_lt=gs1:hasRetailers&test_lang=en", "title": "Where to buy", "type": "text/html", "hreflang": [ "en", "und" ] }, { "linktype": "gs1:hasRetailers", "href": "https://dalgiardino.com/where-to-buy/index.html.es?test_lt=gs1:hasRetailers&test_lang=es", "title": "Donde comprar Dal Giardino", "type": "text/html", "hreflang": [ "es" ] }, { "linktype": "gs1:hasRetailers", "href": "https://dalgiardino.com/where-to-buy/index.html.vi?test_lt=gs1:hasRetailers&test_lang=vi", "title": "N\u01a1i b\u00e1n", "type": "text/html", "hreflang": [ "vi" ] }, { "linktype": "gs1:hasRetailers", "href": "https://dalgiardino.com/risotto-rice-with-mushrooms/index.html.ja?test_lt=gs1:hasRetailers&test_lang=ja", "title": "Product information", "type": "text/html", "hreflang": [ "ja" ] }, { "linktype": "gs1:pip", "href": "https://dalgiardino.com/risotto-rice-with-mushrooms/?test_lt=gs1:pip&test_lang=en-US", "title": "Product information", "type": "text/html", "hreflang": [ "en-US" ] }, { "linktype": "gs1:pip", "href": "https://dalgiardino.com/risotto-rice-with-mushrooms/?test_lt=gs1:pip&test_lang=en", "title": "Product information", "type": "text/html", "hreflang": [ "en" ] }, { "linktype": "gs1:pip", "href": "https://dalgiardino.com/risotto-rice-with-mushrooms/index.html.es?test_lt=gs1:pip&test_lang=es", "title": "Informaci\u00f3n del Producto", "type": "text/html", "hreflang": [ "es" ] }, { "linktype": "gs1:pip", "href": "https://dalgiardino.com/risotto-rice-with-mushrooms/index.html.ja?test_lt=gs1:pip&test_lang=ja", "title": "Product information", "type": "text/html", "hreflang": [ "ja" ] }, { "linktype": "gs1:pip", "href": "https://dalgiardino.com/risotto-rice-with-mushrooms/index.html.vi?test_lt=gs1:pip&test_lang=vi", "title": "Trang th\u00f4ng tin s\u1ea3n ph\u1ea9m", "type": "text/html", "hreflang": [ "vi" ] }, { "linktype": "gs1:recipeInfo", "href": "https://dalgiardino.com/mushroom-squash-risotto/?test_lt=gs1:recipeInfo&test_lang=en", "title": "Wild Mushroom And Butternut Squash Risotto", "type": "text/html", "hreflang": [ "en" ] }, { "linktype": "gs1:recipeInfo", "href": "https://dalgiardino.com/mushroom-squash-risotto/index.html.es?test_lt=gs1:recipeInfo&test_lang=es", "title": "Recetas", "type": "text/html", "hreflang": [ "es" ] }, { "linktype": "gs1:recipeInfo", "href": "https://dalgiardino.com/mushroom-squash-risotto/index.html.es?test_lt=gs1:recipeInfo&test_lang=vi", "title": "Recetas", "type": "text/html", "hreflang": [ "vi" ] }, { "linktype": "gs1:recipeInfo", "href": "https://dalgiardino.com/mushroom-squash-risotto/index.html.ja?test_lt=gs1:recipeInfo&test_lang=ja", "title": "\u30ad\u30ce\u30b3\u3068\u7815\u3044\u305f\u30d0\u30bf\u30fc\u30ca\u30c3\u30c4\u5165\u308a\u306e\u30ea\u30be\u30c3\u30c8", "type": "text/html", "hreflang": [ "ja" ] }, { "linktype": "gs1:sustainabilityInfo", "href": "https://dalgiardino.com/about/?test_lt=gs1:sustainabilityInfo&test_lang=en", "title": "About Dal Giardino", "type": "text/html", "hreflang": [ "en" ] }, { "linktype": "gs1:sustainabilityInfo", "href": "https://dalgiardino.com/about/index.html.es?test_lt=gs1:sustainabilityInfo&test_lang=es", "title": "Sobre Dal Giardino", "type": "text/html", "hreflang": [ "es", "und" ] }, { "linktype": "gs1:sustainabilityInfo", "href": "https://dalgiardino.com/about/index.html.es?test_lt=gs1:sustainabilityInfo&test_lang=ja", "title": "Sobre Dal Giardino", "type": "text/html", "hreflang": [ "ja" ] }, { "linktype": "gs1:sustainabilityInfo", "href": "https://dalgiardino.com/about/index.html.vi?test_lt=gs1:sustainabilityInfo&test_lang=vi", "title": "Ph\u00e1t tri\u1ec3n b\u1ec1n v\u1eefng v\u00e0 t", "type": "text/html", "hreflang": [ "vi" ] } ] }, { "anchor": "/01/09780345418913", "itemDescription": "Dal Giardino Risotto Rice with Mushrooms 411 gr", "defaultLinktype": "gs1:sustainabilityInfo", "qualifiers": [ { "21": "0002" } ], "links": [ { "linktype": "gs1:hasRetailers", "href": "https://dalgiardino.com/where-to-buy/?test_lt=gs1:hasRetailers&test_lang=en", "title": "Where to buy", "type": "text/html", "hreflang": [ "en", "und" ] }, { "linktype": "gs1:hasRetailers", "href": "https://dalgiardino.com/where-to-buy/index.html.es?test_lt=gs1:hasRetailers&test_lang=es", "title": "Donde comprar Dal Giardino", "type": "text/html", "hreflang": [ "es" ] }, { "linktype": "gs1:hasRetailers", "href": "https://dalgiardino.com/where-to-buy/index.html.vi?test_lt=gs1:hasRetailers&test_lang=vi", "title": "N\u01a1i b\u00e1n", "type": "text/html", "hreflang": [ "vi" ] }, { "linktype": "gs1:hasRetailers", "href": "https://dalgiardino.com/risotto-rice-with-mushrooms/index.html.ja?test_lt=gs1:hasRetailers&test_lang=ja", "title": "Product information", "type": "text/html", "hreflang": [ "ja" ] }, { "linktype": "gs1:pip", "href": "https://dalgiardino.com/risotto-rice-with-mushrooms/?test_lt=gs1:pip&test_lang=en-US", "title": "Product information", "type": "text/html", "hreflang": [ "en-US" ] }, { "linktype": "gs1:pip", "href": "https://dalgiardino.com/risotto-rice-with-mushrooms/?test_lt=gs1:pip&test_lang=en", "title": "Product information", "type": "text/html", "hreflang": [ "en" ] }, { "linktype": "gs1:pip", "href": "https://dalgiardino.com/risotto-rice-with-mushrooms/index.html.es?test_lt=gs1:pip&test_lang=es", "title": "Informaci\u00f3n del Producto", "type": "text/html", "hreflang": [ "es" ] }, { "linktype": "gs1:pip", "href": "https://dalgiardino.com/risotto-rice-with-mushrooms/index.html.ja?test_lt=gs1:pip&test_lang=ja", "title": "Product information", "type": "text/html", "hreflang": [ "ja" ] }, { "linktype": "gs1:pip", "href": "https://dalgiardino.com/risotto-rice-with-mushrooms/index.html.vi?test_lt=gs1:pip&test_lang=vi", "title": "Trang th\u00f4ng tin s\u1ea3n ph\u1ea9m", "type": "text/html", "hreflang": [ "vi" ] }, { "linktype": "gs1:recipeInfo", "href": "https://dalgiardino.com/mushroom-squash-risotto/?test_lt=gs1:recipeInfo&test_lang=en", "title": "Wild Mushroom And Butternut Squash Risotto", "type": "text/html", "hreflang": [ "en" ] }, { "linktype": "gs1:recipeInfo", "href": "https://dalgiardino.com/mushroom-squash-risotto/index.html.es?test_lt=gs1:recipeInfo&test_lang=es", "title": "Recetas", "type": "text/html", "hreflang": [ "es" ] }, { "linktype": "gs1:recipeInfo", "href": "https://dalgiardino.com/mushroom-squash-risotto/index.html.es?test_lt=gs1:recipeInfo&test_lang=vi", "title": "Recetas", "type": "text/html", "hreflang": [ "vi" ] }, { "linktype": "gs1:recipeInfo", "href": "https://dalgiardino.com/mushroom-squash-risotto/index.html.ja?test_lt=gs1:recipeInfo&test_lang=ja", "title": "\u30ad\u30ce\u30b3\u3068\u7815\u3044\u305f\u30d0\u30bf\u30fc\u30ca\u30c3\u30c4\u5165\u308a\u306e\u30ea\u30be\u30c3\u30c8", "type": "text/html", "hreflang": [ "ja" ] }, { "linktype": "gs1:sustainabilityInfo", "href": "https://dalgiardino.com/about/?test_lt=gs1:sustainabilityInfo&test_lang=en", "title": "About Dal Giardino", "type": "text/html", "hreflang": [ "en" ] }, { "linktype": "gs1:sustainabilityInfo", "href": "https://dalgiardino.com/about/index.html.es?test_lt=gs1:sustainabilityInfo&test_lang=es", "title": "Sobre Dal Giardino", "type": "text/html", "hreflang": [ "es", "und" ] }, { "linktype": "gs1:sustainabilityInfo", "href": "https://dalgiardino.com/about/index.html.es?test_lt=gs1:sustainabilityInfo&test_lang=ja", "title": "Sobre Dal Giardino", "type": "text/html", "hreflang": [ "ja" ] }, { "linktype": "gs1:sustainabilityInfo", "href": "https://dalgiardino.com/about/index.html.vi?test_lt=gs1:sustainabilityInfo&test_lang=vi", "title": "Ph\u00e1t tri\u1ec3n b\u1ec1n v\u1eefng v\u00e0 t", "type": "text/html", "hreflang": [ "vi" ] } ] } ]

[nicklansley]

Hi Jorge, thanks for your question!

In the case of serial numbers and other qualifiers for the GTIN such as lot number, the data entry only needs to have one entry as long as the destination is the same.

In your example, you have written qualifiers as:
"qualifiers": [ { "21": "0001" } ].

but you can re-write it like this:
"qualifiers": [ { "21": "{serial}" } ].

In this example, I have added a template variable called {serial} in place of the literal value. The characters between the two curly braces can be any value, but importantly that same template variable must be in instances of the 'href' property throughout the rest of the document. For example:

{
"linktype": "gs1:hasRetailers",
"href": "https://dalgiardino.com/where-to-buy/serial={serial}",
"title": "Where to buy",
"type": "text/html",
"hreflang": [ "en", "und" ]
}

In this case, when a request is received by Resolver it substitutes the template variable with the value in the target href URL before issuing the redirect. Clearly the destination web server will need to understand that there is a query value called 'serial' that it needs to read and process.

That will save a lot of MongoDB entries!

[jorgebenzeno]

Hi Nick,

Thank you for your response.

I noticed the use of "{serial}" in the code. Variable templates like "{serial}" are indeed useful for scenarios such as the one you mentioned in your comment. However, from my perspective, and particularly in cases involving traceability where objects must be uniquely identified, variable templates shift the issue I described earlier to the linkset. This is because we need to control the redirection of each object independently of others.

Example 1:
In the case of a window frame industry, we recognize that there are numerous window frames, and their destinations can be various construction sites. When managed by a lot number (AI 10), there would be many lots, each with its own redirection. Moreover, even lots redirecting to the same linkset may require different behaviors depending on client-specific use cases. This necessitates greater control over the granularity of redirections.

Example 2:
We are collaborating with GS1 France under the EU DPP and CIRPASS initiatives. To manage the carbon footprint of a building effectively, it is essential to identify objects at the most granular level using serialized identifiers (AI 21). This level of granularity is critical because objects are not static—they have a lifecycle that spans from the factory to the construction site. At each stage of this lifecycle, their behavior and the information they convey may change.

On the other hand, I find the use of variable templates challenging in certain scenarios:

In the production line for window frames, the ERP (Enterprise Resource Planning) system knows it needs to produce 100 frames today. The system is aware of each frame's geometry and other details, and it creates their digital counterparts (avatars) linked to a digital link. However, I’m unsure how the system could automatically, without human intervention, generate an entry in the resolver that includes something like: "qualifiers": [ { "21": "{serial}" } ]

From my experience, I can’t envision how a system would achieve this to enable the use of variable templates effectively in production. Even if such a solution exists (and I have no doubt it does), the challenge is that each window frame produced does not have a direct representation in the resolver because they are mapped to variable templates.

[jorgebenzeno]

Becasue that, I'm working in a solution for the digital link collection like this

export interface GS1DigitalLink {
identifier: string; // Digital link identifier as aiCode:aiValue
defaultLinktype?: string;
defaultLinkHreflang?: string; // we can ignore this
data: DigitalLinkData;
__internalVersion: GS1ModelVersion; // we can ignore this
}

export interface DigitalLinkData {
qualifiers: DigitalLinkQualifiers[];
descKeyValueQualifier: string; // Concat qualifiers entries as ":key-value" ordered DESC by key // we can ignore this
orderedQualifiers: string[]; // we can ignore this
linkset: Linkset[];
}

Ensuring that MongoDB can quickly find the corresponding entry based on its identifiers and qualifiers is essential for optimizing redirection resolution time and improving the user experience.