Error on replicator when adding set of collections

[jhay06]

Can't make it work when database and collections was set in replicatorCOnfig

"Invalid config: Both database and collections are set at same time"

i test from the instruction and i got that issue

// Purpose -- illustrate a simple change listener
static void simpleChangeListener(void* context,
CBLReplicator* repl,
const CBLReplicatorStatus* status)
{
if(status->error.code != 0) {
printf("Error %d / %d\n",
status->error.domain,
status->error.code);
}
}
// Purpose -- Show configuration , initialization and running of a replicator

// NOTE: No error handling, for brevity (see getting started)
// Note: Android emulator needs to use 10.0.2.2 for localhost (10.0.3.2 for GenyMotion)

CBLError err{};
FLString url = FLSTR("ws://localhost:4984/db");
CBLEndpoint* target = CBLEndpoint_CreateWithURL(url, &err); 

CBLReplicationCollection collectionConfig;
memset(&collectionConfig, 0, sizeof(CBLReplicationCollection));
collectionConfig.collection = collection;

CBLReplicatorConfiguration replConfig;
memset(&replConfig, 0, sizeof(CBLReplicatorConfiguration));
replConfig.collectionCount = 1;
replConfig.collections = &collectionConfig;
replConfig.endpoint = target; 

// Set replication direction and mode
replConfig.replicatorType = kCBLReplicatorTypePull; 
replConfig.continuous = true;

// Optionally, set auto-purge behavior (here we override default)
replConfig.disableAutoPurge = true; 

// Optionally, configure Client Authentication
// Here we are using to Basic Authentication,
// Providing username and password credentials
CBLAuthenticator* basicAuth =
    CBLAuth_CreatePassword(FLSTR("username"),
                           FLSTR("passwd")); 
replConfig.authenticator = basicAuth;

// Optionally, configure how we handle conflicts (note that this is set
// per collection, and not on the overall replicator)
collectionConfig.conflictResolver = simpleConflictResolver_localWins; 

// Initialize replicator with created config
CBLReplicator* replicator =
    CBLReplicator_Create(&replConfig, &err); 

CBLEndpoint_Free(target);

// Optionally, add change listener
CBLListenerToken* token =
        CBLReplicator_AddChangeListener(replicator,
                                        simpleChangeListener,
                                        NULL); 

// Start replication
CBLReplicator_Start(replicator, false); 

removing the collectionConfig from replConfig works but only defaultCollection is being sync.

[pasin]

Probably memset(&replConfig, 0, sizeof(CBLReplicatorConfiguration)); doesn't initialize pointer properties to NULL due to some compiler optimization. Can you try explicitly setting the database property to NULL? or Using {0} or just {} in C++ to initialize replConfig instead of using memset to zero.

[jhay06]

what do you mean by that ?

i tried this
CBLReplicatorConfiguration replConfig = {0};
same error

also this

replConfig.database = {0};

the system crashed

[jhay06]

what i want to achieve is to replicate multiple collection , i try my setup on mac it works but not on windows

it crashed when i do this

CBLReplicationCollection* collectionConfig = new CBLReplicationCollection[len];
for(int i=0; i < this->collections.length; i++){
CBLReplicationCollection col;
col.collection = this->collections.at(i);
collectionConfig[i] = col;

}

replConfig.collectionCount = this->collections.length;
replConfig.collections = collectionConfig;

the above code works on mac, but it crashes on windows

Edit: i got it working now, but the issue right now is the KcBLReplicatorTypePushAndPull,

it doesn't pull ,

[pasin]

There are a couple quick things you can look at the issue:

1. Enable verbose log and see if there are any errors during the replication. If you are not sure what to look at, you can share the log here. To enable the log, CBLLog_SetConsoleLevel(kCBLLogVerbose).

2. In Sync Gateway's sync function, make sure that the documents are routed to the appropriate channels that the user configured to the replicator has access to.

• You can quickly check this by checking http://<SGW>:4984/<db-name>.<scope>.<collection>/_all_docs.
• The sync function is configured per collection and by default, the documents will be routed to the channel named "". Please check that the SGW user you are using is configured to have access to that channel or you can quickly test by configuring the user to have access to all channels (*) channel. For more details, you can look at this doc.
• If you are unsure about this, you can share your SGW config and sync function you are using.

[jhay06]

• You can quickly check this by checking http://<SGW>:4984/<db-name>.<scope>.<collection>/_all_docs.

i tested the travel-sample of the couchbase
and created this config please take a look
{

"log": ["CRUD+", "REST+", "Changes+", "Attach+"],

"interface": "0.0.0.0:4984",

"adminInterface": "0.0.0.0:4985",

"use_tls_server": false,

"databases": {

"travel_sample": {

  "server": "http://127.0.0.1:8091",

  "bucket": "travel-sample",

  "username": "Administrator",

  "password": "password",

  "enable_shared_bucket_access": true,

  "import_docs": true,

  "num_index_replicas": 0,



  "users": {

    "testuser": {

      "password": "password",

      "admin_channels": ["*"]

    },

    "newuser": {

      "password": "password123",

      "admin_channels": ["*"]

    },

    "GUEST": { "disabled": true }

  },



  "scopes": {

    "inventory": {

      "collections": {

        "airline": {

          "sync": "function(doc, oldDoc) { channel(doc.channels); }"

        }

      }

    }

  },

 

  "sync": "function(doc, oldDoc) { channel(doc.channels); }",

  "import_filter": "function(doc) { return true; }"

}

}

}

then i check the url you gave http://localhost:4984/travel_sample.inventory.airline/_all_docs

the response is this

{"rows":[
],
"total_rows":0,"update_seq":195}

i am 100% sure that inventory.airline is existing

[pasin]

The issue is that the sync function routes to the channel that doesn't exist. IIRC, the document from the travel sample app doesn't have the channels property. As you assign the admin channel to the users as "*", you can just assign the doc to any channel names in your sync function such as :

"sync": "function(doc, oldDoc) { channel("airline"); }"

Also, I noticed that you have extra sync function for the default collection at the end, I don't think you need that for the travel sample database. I'm curious, have you gotten this SGW config from one of the tutorials?

[jhay06]

The issue is that the sync function routes to the channel that doesn't exist. IIRC, the document from the travel sample app doesn't have the channels property. As you assign the admin channel to the users as "*", you can just assign the doc to any channel names in your sync function such as :

"sync": "function(doc, oldDoc) { channel("airline"); }"

'

i see will try that ,

Also, I noticed that you have extra sync function for the default collection at the end, I don't think you need that for the travel sample database. I'm curious, have you gotten this SGW config from one of the tutorials?

Yes , i got sgw from many tutorials youtube , google , chatgpt hehehe

[jhay06]

its weird , i still not get any data when using 4984
http://localhost:4984/travel-sample.inventory.airline/_all_docs

but when i used 4985 i got all the data ? already assigned "airline" to the sync function ,
and remove the extra sync function

when running below curl command
curl -u testuser:password -X GET http://localhost:4984/travel-sample.inventory.airline/airline_10

it returns
{"error":"Forbidden","reason":"forbidden"}

but if i try curl -u Administrator:password -X GET http://localhost:4985/travel-sample.inventory.airline/airline_10

it returns the data

[borrrden]

That's not weird, that's exactly what should happen when your user does not have the proper access to the documents. 4985 is the admin port and has access to everything regardless of any permissions / channels.

[jhay06]

adding channels in one of the data , doesn't help.

[pasin]

What did you end up doing with the sync function and the documents?

Given that both testuser and newuser has "admin_channels": ["*"] which means both users has access to all channels, either one of the following will work.

"sync": "function(doc, oldDoc) { channel("airline"); }" // Route the doc to the channel named airline.

"sync": "function(doc, oldDoc) { channel("!"); }" // Route the doc to the public channel

However, if you are using

"sync": "function(doc, oldDoc) { channel(doc.channels); }", your document body needs to include the channels property such as :

{ 
   "name": "foo",
   "channels": ["airline"]
}