Skip to content

配置人大金仓的数据源进行隐私求交失败 #1030

Open
Open
配置人大金仓的数据源进行隐私求交失败#1030
@markzhimm

Description

@markzhimm
markzhimm
opened on Apr 2, 2026

Issue Type

Running

Search for existing issues similar to yours

Yes

OS Platform and Distribution

CentOS Stream 9"

Kuscia Version

kuscia 1.2.0b0

Deployment

docker

deployment Version

Docker version 28.3.3, build 980b856

App Running type

secretflow

App Running version

secretflow-1.11.0b1

Configuration file used to run kuscia.

mode: autonomy
domainID: ccc
domainKeyData: LS0tLS1CRUdJTiBSU0EgUFJJVkFURSBLRVktLS0tLQpNSUlFb3dJQkFBS0NBUUVBeDJ4bGxtL0ZZZHZMVFcxNTJpb2xJdlozWUpWSHdMZUg4N1lxeHhIVyt3MUsrd0N2CkZNRjd2Umh3RWkyWVF5K05TSU5WVDU0U282ZUxYZXdZMW56TGNzeHlaNlFEaHRXM2IxWG5CMjNHa2RJZmt3OWUKbzgzWHRqVGwyTWROTk0vK1VJUm9RYUhVQnR1NUh1WGdzb2oyYnhtU1UzbWRLUnpmakEwYzRZVlhJNEo4U0d0VgpIVWxOc3plRU1QellFQURkMmtpNUdVbTB2cUNqcGxmR01zSXBOR3VVR0taNnAzeFNNL1R5dHBpaDdZaVhhZUNmCldIZFFkaVVpSzlmY1k0Z3hhc255WENjNW9md1BQWHphMmRhQjYwL0FxaGxLaHhPM2xhNVQ3azMvWHJSSlE4ZVoKeDd0cVFYVE8xSkxaWEQzM3M2NjdoMS9jYWd2VE9HTGlQQzFYd1FJREFRQUJBb0lCQUdpUjJXOFo2dGxXaEhOMApUV250b1kyRXliSTJkT3FFRW1Ea0MraFkzVzdGV0tUbmhlY1BVZEFsQ1ZjdTIyR1hoTEVhVk5pcjNjQTg4YUp0ClU5VGNtVjM0QUtHQjZtdUFrM0JwRGZ6aVBqWm1oVEg2NURobWpvODNpN0t4UnpYRFB1cC9rNStldU94anVOMlAKMHRRclozVjRaamNwVlJTaTFFRysrbjd6Q1c5UFpvOXRyc3k5RUQ0ZTc2VmROUDRPbnFaRW4vTm9xWDZ4QVBiTgp1NjVnVEljU3ExYktVOEVEUzNaVnlTdXNxL3BFVnFPWjFtK2ZRMHU2NHVZLy80eXJINzNFWUU0ejluVklZTGNTCjBhTnNaMlNqSDgvMVk5QjZ2eFc1VnFqMldBTzdPYVRrbTArc1dGY2JZM1F3MHdDM1BKZmh5bTJiOHV6VHZqMXQKeldhMmJiVUNnWUVBN2U0NERsbGJwd25UOHlkYXJoTXNzQzFtYzFnenU5aUx2MS9XanE4R2wyK1VTcDhmWlpxOApydTl2Y1NGSkxwQTZTd2FldWdlN3M0K0k3cWdkeGcxWHRUNGxiQ1pVWjZkQzArNjVnQUlBUjBHdUpEYkRjbTdpCkhLZWpIVzBUK2d6elFJaC9QeXZsYzZtS29MakZJNmNRclZsMm4ySWxCejRxbUhVMTAzSXkrcmNDZ1lFQTFwR0kKYmVUa295aTRpMGJuL0NZMHRkL1FTNXYzMlBJS3JITmp6M0FKV1lmQzlGVG11TFlpTXFDZjRZR1pyZkNiMVRaSQpGZ0pJK1YwQ25JYythY1B6cmY4K3NvUGtRd3VQZmhMWnlZbzhWd21JRWpRRlltakRRb2dEVzd3Zk0vV3hLK1JkClN2U1RlaFpxYk96b1FoYWc4cmxKTytDSFBOVC8zSE9DNmZDeHFVY0NnWUVBemtiRFRwMWwrbkZvMGR3Q24veDcKdDlvRWdtZXJvbVhnOG0reVlrMlgxMTZqSC9iSWo1d1JqVkNFTzM1eUplNWd1MzdueWJ5K25MUUtNVzZMTVpPTAp3TlE2T1lNWmxpdktvbGJMZUJGRUVJTCs2T0tabS9KS0VqRzhGdHprZnRzUFlabDFTRjFVTm14OGhVN3JpemRpCkhBZjk4Ynh6QWM2QnUxK1M1TmlUSGcwQ2dZQk1rb3M1aktIN2lDQ3pzNDQrY2ZRRm8rWFYxY2RSYUs5ZWM1OSsKKytDYVR0VElGVFJ4WHE0OW13enprU2lpNW1iMlkvUzl4ZnI4NHJCMzQ5dm1Lc1BmcUdOYm1hM3dMMFA2SGdnUwo0SDVBSVdxcDlGNm5pL09DM3I4MEVhS2hER0U1NUxsV2NvbmUyL2tHL2xTMG9SYTNDR0NXT2I2SmV3b0VSa1RGCjc5dTNLUUtCZ0RQUGlwN3VKelBwK1JFSWpmMkxiSWpVL1BuVlk4VVA4Q2tncGtkemZMdHBQN0tUQWs3OFkybzYKQnhiMkI2UjZJYnkzM1VrTWRGWHVkTE9RdVVYTkY1a0w5TnpLRldWdjdnbzVoMk50dEV6b3o5MTh6NmhZNmljUAovVlFDQktZY1cvTDhOZ01JRlo2eGFmRXhwMkxhYVl2dlNsT3lWOXB0NGZ1MUpvY1Faa2tnCi0tLS0tRU5EIFJTQSBQUklWQVRFIEtFWS0tLS0tCg==
logLevel: INFO
protocol: mtls
runtime: runc
runk:
  namespace: ""
  dnsServers: []
  kubeconfigFile: ""
  enableLogging: false
  logDirectory: ""
  logMaxFiles: 0
  logMaxSize: ""
capacity:
  cpu: ""
  memory: ""
  pods: ""
  storage: ""
  ephemeralStorage: ""
reservedResources:
  cpu: ""
  memory: ""
image:
  pullPolicy: ""
  defaultRegistry: ""
  registries: []
datastoreEndpoint: ""

dataMesh:
  dataProxyList:
    - endpoint: "dataproxy-grpc:8023"
      dataSourceTypes:
        - "odps"

What happend and What you expected to happen.

2026-04-02 19:16:32 INFO the jobId=zzqo, taskId=zzqo-fkeoicng-node-33 start ...
2026-04-02 19:16:41 INFO the jobId=zzqo, taskId=zzqo-fkeoicng-node-33 failed: party ccc failed msg: container[secretflow] terminated state reason "Error", message: "2026-04-02 11:16:39,496|ccc|INFO|secretflow|entry.py:main:541| datasource.access_directly False
sf_node_eval_param  {
  \"domain\": \"data_prep\",
  \"name\": \"psi_tp\",
  \"version\": \"1.0.0\",
  \"attrPaths\": [
    \"input/input_ds1/keys1\",
    \"input/input_ds2/keys2\",
    \"input/input_ds3/keys3\",
    \"ecdh_curve\"
  ],
  \"attrs\": [
    {
      \"ss\": [
        \"id1\"
      ]
    },
    {
      \"ss\": [
        \"id2\"
      ]
    },
    {
      \"ss\": [
        \"id3\"
      ]
    },
    {
      \"s\": \"CURVE_25519\"
    }
  ],
  \"inputs\": [
    {
      \"type\": \"sf.table.individual\",
      \"meta\": {
        \"@type\": \"type.googleapis.com/secretflow.spec.v1.IndividualTable\",
        \"lineCount\": \"-1\"
      },
      \"dataRefs\": [
        {
          \"uri\": \"alice_1973047507.csv\",
          \"party\": \"alice\",
          \"format\": \"csv\"
        }
      ]
    },
    {
      \"type\": \"sf.table.individual\",
      \"meta\": {
        \"@type\": \"type.googleapis.com/secretflow.spec.v1.IndividualTable\",
        \"lineCount\": \"-1\"
      },
      \"dataRefs\": [
        {
          \"uri\": \"ccc-tb\",
          \"party\": \"ccc\",
          \"format\": \"csv\"
        }
      ]
    },
    {
      \"type\": \"sf.table.individual\",
      \"meta\": {
        \"@type\": \"type.googleapis.com/secretflow.spec.v1.IndividualTable\",
        \"lineCount\": \"-1\"
      },
      \"dataRefs\": [
        {
          \"uri\": \"sf2-tb\",
          \"party\": \"sf2\",
          \"format\": \"csv\"
        }
      ]
    }
  ],
  \"checkpointUri\": \"ckzzqo-fkeoicng-node-33-output-0\"
} 
2026-04-02 11:16:39,504|ccc|INFO|secretflow|entry.py:domaindata_id_to_dist_data:165| domaindata_id svgoskxs to 
...........
name: \"alice_csv_new\"
type: \"sf.table.individual\"
meta {
  type_url: \"type.googleapis.com/secretflow.spec.v1.IndividualTable\"
  value: \"\
\\257\\003\\022\\003id1\\022\\003age\\022\\teducation\\022\\013default_val\\022\\007balance\\022\\007housing\\022\\004loan\\022\\003day\\022\\010duration\\022\\010campaign\\022\\005pdays\\022\\010previous\\022\\020job_entrepreneur\\022\\rjob_housemaid\\022\\016job_management\\022\\013job_retired\\022\\014job_services\\022\\013job_student\\022\\016job_technician\\022\\016job_unemployed\\022\\020marital_divorced\\022\\017marital_married\\022\\016marital_single*\\003int*\\005float*\\005float*\\005float*\\005float*\\005float*\\005float*\\005float*\\005float*\\005float*\\005float*\\005float*\\005float*\\005float*\\005float*\\005float*\\005float*\\005float*\\005float*\\005float*\\005float*\\005float*\\005float\\020\\377\\377\\377\\377\\377\\377\\377\\377\\377\\001\"
}
data_refs {
  uri: \"alice_1973047507.csv\"
  party: \"alice\"
  format: \"csv\"
  null_strs: \"\"
}

....
2026-04-02 11:16:39,510|ccc|INFO|secretflow|entry.py:domaindata_id_to_dist_data:165| domaindata_id ppmbddgz to 
...........
name: \"ccc-kb\"
type: \"sf.table.individual\"
meta {
  type_url: \"type.googleapis.com/secretflow.spec.v1.IndividualTable\"
  value: \"\
,\\022\\003id2\\022\\021contact_telephone\\022\\001y*\\003int*\\005float*\\003int\\020\\377\\377\\377\\377\\377\\377\\377\\377\\377\\001\"
}
data_refs {
  uri: \"ccc-tb\"
  party: \"ccc\"
  format: \"csv\"
  null_strs: \"\"
}

....
2026-04-02 11:16:39,510|ccc|INFO|secretflow|file_adapter.py:download_file:45| dataproxy sdk: start download_file[/tmp/sf_zzqo-fkeoicng-node-33_ccc/ccc-tb], type[1]
2026-04-02 11:16:39,595|ccc|ERROR|secretflow|entry.py:<module>:585| unexpected exception
Traceback (most recent call last):
  File \"/usr/local/lib/python3.10/site-packages/secretflow/kuscia/entry.py\", line 583, in <module>
    main()
  File \"/usr/local/lib/python3.10/site-packages/click/core.py\", line 1161, in __call__
    return self.main(*args, **kwargs)
  File \"/usr/local/lib/python3.10/site-packages/click/core.py\", line 1082, in main
    rv = self.invoke(ctx)
  File \"/usr/local/lib/python3.10/site-packages/click/core.py\", line 1443, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File \"/usr/local/lib/python3.10/site-packages/click/core.py\", line 788, in invoke
    return __callback(*args, **kwargs)
  File \"/usr/local/lib/python3.10/site-packages/secretflow/kuscia/entry.py\", line 545, in main
    sf_node_eval_param = preprocess_sf_node_eval_param(
  File \"/usr/local/lib/python3.10/site-packages/secretflow/kuscia/entry.py\", line 297, in preprocess_sf_node_eval_param
    domaindata_id_to_dist_data(
  File \"/usr/local/lib/python3.10/site-packages/secretflow/kuscia/entry.py\", line 171, in domaindata_id_to_dist_data
    download_dist_data_from_dp(
  File \"/usr/local/lib/python3.10/site-packages/secretflow/kuscia/entry.py\", line 110, in download_dist_data_from_dp
    get_file_from_dp(
  File \"/usr/local/lib/python3.10/site-packages/secretflow/kuscia/datamesh.py\", line 147, in get_file_from_dp
    dm_flight_client.download_file(download_info, output_file_path, file_format)
  File \"/usr/local/lib/python3.10/site-packages/dataproxy/file_adapter.py\", line 49, in download_file
    self.file.download_file(info.SerializeToString(), file_path, file_format)
RuntimeError: what: 
\t[dataproxy_sdk/cc/data_proxy_conn.cc:51] Invalid: Flight returned invalid argument error, with message: datasource type (kingbase) without data proxy
Stacktrace:
#0 dataproxy_sdk::DataProxyConn::Impl::DoGet()+0x7fa578d6405c
#1 dataproxy_sdk::DataProxyConn::DoGet()+0x7fa578d645a4
#2 dataproxy_sdk::DataProxyFile::Impl::DownloadFile()+0x7fa578d5073f
#3 pybind11::cpp_function::initialize<>()::{lambda()#3}::_FUN()+0x7fa578d3e852
#4 pybind11::cpp_function::dispatcher()+0x7fa578d263ff
#5 cfunction_call+0x4fc697


"

Kuscia log output.

2026-04-02 19:16:32 INFO the jobId=zzqo, taskId=zzqo-fkeoicng-node-33 start ...
2026-04-02 19:16:41 INFO the jobId=zzqo, taskId=zzqo-fkeoicng-node-33 failed: party ccc failed msg: container[secretflow] terminated state reason "Error", message: "2026-04-02 11:16:39,496|ccc|INFO|secretflow|entry.py:main:541| datasource.access_directly False
sf_node_eval_param  {
  \"domain\": \"data_prep\",
  \"name\": \"psi_tp\",
  \"version\": \"1.0.0\",
  \"attrPaths\": [
    \"input/input_ds1/keys1\",
    \"input/input_ds2/keys2\",
    \"input/input_ds3/keys3\",
    \"ecdh_curve\"
  ],
  \"attrs\": [
    {
      \"ss\": [
        \"id1\"
      ]
    },
    {
      \"ss\": [
        \"id2\"
      ]
    },
    {
      \"ss\": [
        \"id3\"
      ]
    },
    {
      \"s\": \"CURVE_25519\"
    }
  ],
  \"inputs\": [
    {
      \"type\": \"sf.table.individual\",
      \"meta\": {
        \"@type\": \"type.googleapis.com/secretflow.spec.v1.IndividualTable\",
        \"lineCount\": \"-1\"
      },
      \"dataRefs\": [
        {
          \"uri\": \"alice_1973047507.csv\",
          \"party\": \"alice\",
          \"format\": \"csv\"
        }
      ]
    },
    {
      \"type\": \"sf.table.individual\",
      \"meta\": {
        \"@type\": \"type.googleapis.com/secretflow.spec.v1.IndividualTable\",
        \"lineCount\": \"-1\"
      },
      \"dataRefs\": [
        {
          \"uri\": \"ccc-tb\",
          \"party\": \"ccc\",
          \"format\": \"csv\"
        }
      ]
    },
    {
      \"type\": \"sf.table.individual\",
      \"meta\": {
        \"@type\": \"type.googleapis.com/secretflow.spec.v1.IndividualTable\",
        \"lineCount\": \"-1\"
      },
      \"dataRefs\": [
        {
          \"uri\": \"sf2-tb\",
          \"party\": \"sf2\",
          \"format\": \"csv\"
        }
      ]
    }
  ],
  \"checkpointUri\": \"ckzzqo-fkeoicng-node-33-output-0\"
} 
2026-04-02 11:16:39,504|ccc|INFO|secretflow|entry.py:domaindata_id_to_dist_data:165| domaindata_id svgoskxs to 
...........
name: \"alice_csv_new\"
type: \"sf.table.individual\"
meta {
  type_url: \"type.googleapis.com/secretflow.spec.v1.IndividualTable\"
  value: \"\
\\257\\003\\022\\003id1\\022\\003age\\022\\teducation\\022\\013default_val\\022\\007balance\\022\\007housing\\022\\004loan\\022\\003day\\022\\010duration\\022\\010campaign\\022\\005pdays\\022\\010previous\\022\\020job_entrepreneur\\022\\rjob_housemaid\\022\\016job_management\\022\\013job_retired\\022\\014job_services\\022\\013job_student\\022\\016job_technician\\022\\016job_unemployed\\022\\020marital_divorced\\022\\017marital_married\\022\\016marital_single*\\003int*\\005float*\\005float*\\005float*\\005float*\\005float*\\005float*\\005float*\\005float*\\005float*\\005float*\\005float*\\005float*\\005float*\\005float*\\005float*\\005float*\\005float*\\005float*\\005float*\\005float*\\005float*\\005float\\020\\377\\377\\377\\377\\377\\377\\377\\377\\377\\001\"
}
data_refs {
  uri: \"alice_1973047507.csv\"
  party: \"alice\"
  format: \"csv\"
  null_strs: \"\"
}

....
2026-04-02 11:16:39,510|ccc|INFO|secretflow|entry.py:domaindata_id_to_dist_data:165| domaindata_id ppmbddgz to 
...........
name: \"ccc-kb\"
type: \"sf.table.individual\"
meta {
  type_url: \"type.googleapis.com/secretflow.spec.v1.IndividualTable\"
  value: \"\
,\\022\\003id2\\022\\021contact_telephone\\022\\001y*\\003int*\\005float*\\003int\\020\\377\\377\\377\\377\\377\\377\\377\\377\\377\\001\"
}
data_refs {
  uri: \"ccc-tb\"
  party: \"ccc\"
  format: \"csv\"
  null_strs: \"\"
}

....
2026-04-02 11:16:39,510|ccc|INFO|secretflow|file_adapter.py:download_file:45| dataproxy sdk: start download_file[/tmp/sf_zzqo-fkeoicng-node-33_ccc/ccc-tb], type[1]
2026-04-02 11:16:39,595|ccc|ERROR|secretflow|entry.py:<module>:585| unexpected exception
Traceback (most recent call last):
  File \"/usr/local/lib/python3.10/site-packages/secretflow/kuscia/entry.py\", line 583, in <module>
    main()
  File \"/usr/local/lib/python3.10/site-packages/click/core.py\", line 1161, in __call__
    return self.main(*args, **kwargs)
  File \"/usr/local/lib/python3.10/site-packages/click/core.py\", line 1082, in main
    rv = self.invoke(ctx)
  File \"/usr/local/lib/python3.10/site-packages/click/core.py\", line 1443, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File \"/usr/local/lib/python3.10/site-packages/click/core.py\", line 788, in invoke
    return __callback(*args, **kwargs)
  File \"/usr/local/lib/python3.10/site-packages/secretflow/kuscia/entry.py\", line 545, in main
    sf_node_eval_param = preprocess_sf_node_eval_param(
  File \"/usr/local/lib/python3.10/site-packages/secretflow/kuscia/entry.py\", line 297, in preprocess_sf_node_eval_param
    domaindata_id_to_dist_data(
  File \"/usr/local/lib/python3.10/site-packages/secretflow/kuscia/entry.py\", line 171, in domaindata_id_to_dist_data
    download_dist_data_from_dp(
  File \"/usr/local/lib/python3.10/site-packages/secretflow/kuscia/entry.py\", line 110, in download_dist_data_from_dp
    get_file_from_dp(
  File \"/usr/local/lib/python3.10/site-packages/secretflow/kuscia/datamesh.py\", line 147, in get_file_from_dp
    dm_flight_client.download_file(download_info, output_file_path, file_format)
  File \"/usr/local/lib/python3.10/site-packages/dataproxy/file_adapter.py\", line 49, in download_file
    self.file.download_file(info.SerializeToString(), file_path, file_format)
RuntimeError: what: 
\t[dataproxy_sdk/cc/data_proxy_conn.cc:51] Invalid: Flight returned invalid argument error, with message: datasource type (kingbase) without data proxy
Stacktrace:
#0 dataproxy_sdk::DataProxyConn::Impl::DoGet()+0x7fa578d6405c
#1 dataproxy_sdk::DataProxyConn::DoGet()+0x7fa578d645a4
#2 dataproxy_sdk::DataProxyFile::Impl::DownloadFile()+0x7fa578d5073f
#3 pybind11::cpp_function::initialize<>()::{lambda()#3}::_FUN()+0x7fa578d3e852
#4 pybind11::cpp_function::dispatcher()+0x7fa578d263ff
#5 cfunction_call+0x4fc697


"

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions