Discussion on PCB-AOI Single-Task and Incremental Learning: Path Errors and Dependency Conflicts

[AryanNanda17]

What happened:

While following the quick start instructions from documentation of ianvs, I encountered a bug.
On running,

ianvs -f ./examples/pcb-aoi/singletask_learning_bench/benchmarkingjob.yaml

I got following exception:-

Traceback (most recent call last):
  File "/home/aryan/mambaforge/envs/ianvs1/lib/python3.8/site-packages/ianvs-0.1.0-py3.8.egg/core/cmd/benchmarking.py", line 37, in main
    job.run()
  File "/home/aryan/mambaforge/envs/ianvs1/lib/python3.8/site-packages/ianvs-0.1.0-py3.8.egg/core/cmd/obj/benchmarkingjob.py", line 89, in run
    self.test_env.prepare()
  File "/home/aryan/mambaforge/envs/ianvs1/lib/python3.8/site-packages/ianvs-0.1.0-py3.8.egg/core/testenvmanager/testenv/testenv.py", line 80, in prepare
    raise RuntimeError(f"prepare dataset failed, error: {err}.") from err
RuntimeError: prepare dataset failed, error: not one of train_index/train_data/train_data_info.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/home/aryan/mambaforge/envs/ianvs1/bin/ianvs", line 33, in <module>
    sys.exit(load_entry_point('ianvs==0.1.0', 'console_scripts', 'ianvs')())
  File "/home/aryan/mambaforge/envs/ianvs1/lib/python3.8/site-packages/ianvs-0.1.0-py3.8.egg/core/cmd/benchmarking.py", line 41, in main
    raise RuntimeError(f"benchmarkingjob runs failed, error: {err}.") from err
RuntimeError: benchmarkingjob runs failed, error: prepare dataset failed, error: not one of train_index/train_data/train_data_info..

What you expected to happen:
I expected that benchmarks will be happen.
How to reproduce it (as minimally and precisely as possible):
Please run the quick start guide from here
Anything else we need to know?:
Not neccesarily

[AryanNanda17]

@MooreZheng, any idea why this happened?
Am I doing something wrong?
Thanks

[AryanNanda17]

Okay,
I changed the train_url and test_url to train_index and test_index here. the above error seems to be resolved.

[AryanNanda17]

Also, as per the documentation there should be no fault detection folder, files should be placed directly inside singletask_learning_bench/

[AryanNanda17]

@MooreZheng, which version of tensorflow should I go with.
packages like import tensorflow.contrib.slim as slim is deprecated in tensorflow version 2.0. Instead of this package for importing slim module we do import tf_slim as slim in v2.x of tensorflow.
We are using depricated version here

[AryanNanda17]

the current error that I am facing is

RuntimeError: benchmarkingjob runs failed, error: testcase(id=84de58c0-cb4e-11ef-9f00-65cc74a7c013) runs failed, error: (paradigm=singletasklearning) pipeline runs failed, error: module(type=basemodel loads class(name=FPN) failed, error: load module(url=./examples/pcb-aoi/singletask_learning_bench/testalgorithms/fpn/basemodel.py) 
failed, error: No module named 'FPN_TensorFlow'..

[AryanNanda17]

@FuryMartin do you have any idea about this ?

[FuryMartin]

the current error that I am facing is

RuntimeError: benchmarkingjob runs failed, error: testcase(id=84de58c0-cb4e-11ef-9f00-65cc74a7c013) runs failed, error: (paradigm=singletasklearning) pipeline runs failed, error: module(type=basemodel loads class(name=FPN) failed, error: load module(url=./examples/pcb-aoi/singletask_learning_bench/testalgorithms/fpn/basemodel.py) 
failed, error: No module named 'FPN_TensorFlow'..

This is a custom module in pcb-aoi. Althought I don't know the implemetation details of this module, I remember it can be installed by

pip install examples/resources/algorithms/FPN_TensorFlow-0.1-py3-none-any.whl 

This quick start seems to have some issues, you may also want to check #142 (comment) and #132 (comment) if you encounter new problems.

[FuryMartin]

Also, as per the documentation there should be no fault detection folder, files should be placed directly inside singletask_learning_bench/

Yes, it's a known bug. Would you mind opening a PR to solve this?

[AryanNanda17]

Would you mind opening a PR to solve this?

Sure will do that

[AryanNanda17]

pip install examples/resources/algorithms/FPN_TensorFlow-0.1-py3-none-any.whl 

This wheel only supports tensorflow version 1.x, and it is only available in Python version <=3.7

[AryanNanda17]

Getting this error when i use python version 3.7

(ianvsV3.7) aryan@aryan-HP-EliteBook-840-G4:~/ianvs/project/ianvs$ python -m pip install examples/resources/algorithms/FPN_TensorFlow-0.1-py3-none-any.whl
Processing ./examples/resources/algorithms/FPN_TensorFlow-0.1-py3-none-any.whl
Collecting wheel~=0.36.2 (from FPN-TensorFlow==0.1)
  Using cached wheel-0.36.2-py2.py3-none-any.whl.metadata (2.3 kB)
Collecting libs~=0.0.10 (from FPN-TensorFlow==0.1)
  Using cached libs-0.0.10-py3-none-any.whl.metadata (831 bytes)
Collecting tensorflow~=1.14.0 (from FPN-TensorFlow==0.1)
  Downloading tensorflow-1.14.0-cp37-cp37m-manylinux1_x86_64.whl.metadata (2.4 kB)
Collecting matplotlib~=3.3.4 (from FPN-TensorFlow==0.1)
  Downloading matplotlib-3.3.4-cp37-cp37m-manylinux1_x86_64.whl.metadata (5.7 kB)
Collecting Pillow~=8.1.1 (from FPN-TensorFlow==0.1)
  Downloading Pillow-8.1.2-cp37-cp37m-manylinux1_x86_64.whl.metadata (7.1 kB)
Collecting tqdm~=4.62.3 (from FPN-TensorFlow==0.1)
  Downloading tqdm-4.62.3-py2.py3-none-any.whl.metadata (56 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57.0/57.0 kB 1.2 MB/s eta 0:00:00
INFO: pip is looking at multiple versions of fpn-tensorflow to determine which version is compatible with other requirements. This could take a while.
ERROR: Ignored the following versions that require a different python version: 0.43.0 Requires-Python >=3.8; 0.44.0 Requires-Python >=3.8; 0.45.0 Requires-Python >=3.8; 0.45.1 Requires-Python >=3.8; 0.7 Requires-Python >=3.6, <3.7; 0.8 Requires-Python >=3.6, <3.7; 10.0.0 Requires-Python >=3.8; 10.0.1 Requires-Python >=3.8; 10.1.0 Requires-Python >=3.8; 10.2.0 Requires-Python >=3.8; 10.3.0 Requires-Python >=3.8; 10.4.0 Requires-Python >=3.8; 11.0.0 Requires-Python >=3.9; 11.1.0 Requires-Python >=3.9; 3.10.0 Requires-Python >=3.10; 3.10.0rc1 Requires-Python >=3.10; 3.6.0 Requires-Python >=3.8; 3.6.0rc1 Requires-Python >=3.8; 3.6.0rc2 Requires-Python >=3.8; 3.6.1 Requires-Python >=3.8; 3.6.2 Requires-Python >=3.8; 3.6.3 Requires-Python >=3.8; 3.7.0 Requires-Python >=3.8; 3.7.0rc1 Requires-Python >=3.8; 3.7.1 Requires-Python >=3.8; 3.7.2 Requires-Python >=3.8; 3.7.3 Requires-Python >=3.8; 3.7.4 Requires-Python >=3.8; 3.7.5 Requires-Python >=3.8; 3.8.0 Requires-Python >=3.9; 3.8.0rc1 Requires-Python >=3.9; 3.8.1 Requires-Python >=3.9; 3.8.2 Requires-Python >=3.9; 3.8.3 Requires-Python >=3.9; 3.8.4 Requires-Python >=3.9; 3.9.0 Requires-Python >=3.9; 3.9.0rc2 Requires-Python >=3.9; 3.9.1 Requires-Python >=3.9; 3.9.1.post1 Requires-Python >=3.9; 3.9.2 Requires-Python >=3.9; 3.9.3 Requires-Python >=3.9; 3.9.4 Requires-Python >=3.9
ERROR: Could not find a version that satisfies the requirement dataclasses~=0.8 (from fpn-tensorflow) (from versions: 0.1, 0.2, 0.3, 0.4, 0.5, 0.6)
ERROR: No matching distribution found for dataclasses~=0.8

[AryanNanda17]

And on using python version 3.8 getting the following error:-

aryan@aryan-HP-EliteBook-840-G4:~/ianvs/project/ianvs$ conda activate ianvsV3.8
(ianvsV3.8) aryan@aryan-HP-EliteBook-840-G4:~/ianvs/project/ianvs$ python -m pip install examples/resources/algorithms/FPN_TensorFlow-0.1-py3-none-any.whl
Processing ./examples/resources/algorithms/FPN_TensorFlow-0.1-py3-none-any.whl
Collecting wheel~=0.36.2 (from FPN-TensorFlow==0.1)
  Using cached wheel-0.36.2-py2.py3-none-any.whl.metadata (2.3 kB)
Collecting libs~=0.0.10 (from FPN-TensorFlow==0.1)
  Using cached libs-0.0.10-py3-none-any.whl.metadata (831 bytes)
INFO: pip is looking at multiple versions of fpn-tensorflow to determine which version is compatible with other requirements. This could take a while.
ERROR: Could not find a version that satisfies the requirement tensorflow~=1.14.0 (from fpn-tensorflow) (from versions: 2.2.0, 2.2.1, 2.2.2, 2.2.3, 2.3.0, 2.3.1, 2.3.2, 2.3.3, 2.3.4, 2.4.0, 2.4.1, 2.4.2, 2.4.3, 2.4.4, 2.5.0, 2.5.1, 2.5.2, 2.5.3, 2.6.0rc0, 2.6.0rc1, 2.6.0rc2, 2.6.0, 2.6.1, 2.6.2, 2.6.3, 2.6.4, 2.6.5, 2.7.0rc0, 2.7.0rc1, 2.7.0, 2.7.1, 2.7.2, 2.7.3, 2.7.4, 2.8.0rc0, 2.8.0rc1, 2.8.0, 2.8.1, 2.8.2, 2.8.3, 2.8.4, 2.9.0rc0, 2.9.0rc1, 2.9.0rc2, 2.9.0, 2.9.1, 2.9.2, 2.9.3, 2.10.0rc0, 2.10.0rc1, 2.10.0rc2, 2.10.0rc3, 2.10.0, 2.10.1, 2.11.0rc0, 2.11.0rc1, 2.11.0rc2, 2.11.0, 2.11.1, 2.12.0rc0, 2.12.0rc1, 2.12.0, 2.12.1, 2.13.0rc0, 2.13.0rc1, 2.13.0rc2, 2.13.0, 2.13.1)
ERROR: No matching distribution found for tensorflow~=1.14.0

[FuryMartin]

pip install examples/resources/algorithms/FPN_TensorFlow-0.1-py3-none-any.whl 

This wheel only supports tensorflow version 1.x, and it is only available in Python version <=3.7

You are right, creating a env with python==3.6 will fix this.

I once discussed Ianvs's dependency issues in #132 , but no community consensus has been reached yet.