Release 2.7.1

What's new

Enhancements

• Performance Improvements:
  • Updated PersistDict to the latest version for better performance.
  • Improved the efficiency of embeddings by attempting in-memory caching during load.
• Model Handling:
  • Introduced adjustments to avoid reliance on external sources like litellm for model parameters and maximum tokens.
  • Implemented memoization for frequently called model name handlers to reduce computation times.
• Testing Experience:
  • Integrated pytest-xdist to parallelize and speed up the test execution.
  • Optimized test performance by utilizing a session fixture scope.

Bug Fixes

• Performance Fine-tuning:
  • Corrected versioning discrepancies for incrementals.
  • Addressed issues with multiple output answer handling.
• Logging and Debugging:
  • Enhanced debug message levels to provide clearer output.
  • Resolved issues with redundant logger information.
• Model Compatibility:
  • Amended model parameter defaults where strict support was unavailable.
  • Improved the hash method in ModelName for cache support integrity.
  • Fixed exit value inconsistency in create_embeddings.

Minor Changes

• Code Refinement:
  • Eliminated unused arguments and flags for simplified code.
  • Enhanced error messages for better clarity during debugging.

Commits details since the last release

• [5679fd9] by @thiswillbeyourgithub, 7 minutes ago:
  bump PersistDict to latest version for perf
  Signed-off-by: thiswillbeyourgithub
  26625900+thiswillbeyourgithub@users.noreply.github.com

setup.py

• [63d3386] by @thiswillbeyourgithub, 60 minutes ago:
  bump version 2.7.0 -> 2.7.1

bumpver.toml
docs/source/conf.py
setup.py
wdoc/wdoc.py

• [78faa58] by @thiswillbeyourgithub, 34 minutes ago:
  fix: use latest verdion of persistic for better performance
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

setup.py

• [9ff9176] by @thiswillbeyourgithub, 55 minutes ago:
  minor: the message to start langfuse shouod be in debug level
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/misc.py

• [5f21bc9] by @thiswillbeyourgithub, 69 minutes ago:
  new: no need actually to print message when bypassinh model name matching
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/misc.py

• [a37e732] by @thiswillbeyourgithub, 71 minutes ago:
  fix: handle multiple output answers

wdoc/wdoc.py

• [9cd6407] by @thiswillbeyourgithub, 4 hours ago:
  new: try to cache embeddings in memory when loading them
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/embeddings.py
wdoc/utils/misc.py

• [9b11e82] by @thiswillbeyourgithub, 4 hours ago:
  new: use a debug print when bypassing a modelname matching
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/misc.py

• [5cfa86a] by @thiswillbeyourgithub, 4 hours ago:
  new: update the model parameters if it actually does not support n
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/wdoc.py

• [5202b45] by @thiswillbeyourgithub, 4 hours ago:
  fix: better handling of models that do not support modifying the n parameter
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/docs/help.md
wdoc/wdoc.py

• [9d1e4f6] by @thiswillbeyourgithub, 4 hours ago:
  fix: add hash method to ModelName to make it work with caches
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/misc.py

• [72f6409] by @thiswillbeyourgithub, 4 hours ago:
  new: try to avoid trusting litellm or openrouter for model parameters and max_tokens
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/misc.py

• [d689b6a] by @thiswillbeyourgithub, 4 hours ago:
  new: add memoize decorator to frequently called model name handlers
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/misc.py

• [21108bd] by @thiswillbeyourgithub, 4 hours ago:
  minor: forgot a type checker decorator
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/misc.py

• [ffa0f80] by @thiswillbeyourgithub, 5 hours ago:
  minor: better error message
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/wdoc.py

• [ec8682f] by @thiswillbeyourgithub, 5 hours ago:
  fix: forgot to update an exit value in create_embeddings
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/embeddings.py

• [6933655] by @thiswillbeyourgithub, 3 days ago:
  use pytest-xdist when running all tests
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

tests/run_all_tests.sh

• [371ed6c] by @thiswillbeyourgithub, 3 days ago:
  add pytest xdist to setup
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

setup.py

• [3bb7596] by @thiswillbeyourgithub, 3 days ago:
  test: use scope session fixture for pytest to make them faster
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

tests/conftest.py

• [00c46ca] by @thiswillbeyourgithub, 3 days ago:
  fix: forgot to remove a logger.info duplicate line
  Signed-off-by: thiswillbeyourgithub
  26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/logger.py

• [49fcb23] by @thiswillbeyourgithub, 3 days ago:
  remove the is_silent argument and flag that are not used anymore
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/docs/help.md
wdoc/utils/flags.py
wdoc/utils/logger.py

• [3882630] by @thiswillbeyourgithub, 3 days ago:
  new: use the logger instead of tqdm write to avoid duplicate prints and have better importability
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/logger.py

Release 2.7.0

What's new

🆕 New Features

• Mentioned the inclusion of the official open webui tool across relevant documentation
• Removed initial line "a deep breath" from summary output
• Change default import type to native (safer but slower)

🐛 Fixes

• Resolved undefined arguments and keyword arguments issue:
  • Bug fix conducted in the EnvVar.__getattr__ method.

📝 Documentation Improvements

• Minor updates to improve readability and consistency.

---

Commits details since the last release

• [bd87c00] by @thiswillbeyourgithub, 25 minutes ago:
  bump version 2.6.10 -> 2.7.0

bumpver.toml
docs/source/conf.py
setup.py
wdoc/wdoc.py

• [15b67b3] by @thiswillbeyourgithub, 25 minutes ago:
  docs: minor
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

README.md

• [3995840] by @thiswillbeyourgithub, 25 minutes ago:
  docs: mention open webui tool everywhere
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

README.md
wdoc/docs/examples.md

• [4cf0576] by @thiswillbeyourgithub (aider), 3 hours ago:
  new: Remove first line containing "a deep breath" from LLM output

wdoc/utils/tasks/summarize.py

• [82a52e6] by @thiswillbeyourgithub (aider), 3 hours ago:
  fix: Resolve undefined args and kwargs in EnvVar.getattr method

wdoc/utils/env.py

• [81c2c2c] by @thiswillbeyourgithub (aider), 3 hours ago:
  new: Change default import type to native and update documentation

wdoc/docs/help.md
wdoc/utils/env.py

Release 2.6.10

What's new

Release Highlights

Fixes

• Typographical Correction:
  • Resolved a typo issue causing crashes when using tags.
  • File Modified:
    • wdoc/utils/llm.py

Commits details since the last release

• [ef58891] by @thiswillbeyourgithub, 4 minutes ago:
  bump version 2.6.9 -> 2.6.10

bumpver.toml
docs/source/conf.py
setup.py
wdoc/wdoc.py

• [f442f78] by @thiswillbeyourgithub, 4 minutes ago:
  fix: crashing typo when using tags
  Signed-off-by: thiswillbeyourgithub
  26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/llm.py

Release 2.6.9

What's new

Enhancements

• Version Update
  • Updated from version 2.6.8 to 2.6.9 to reflect the latest changes and improvements.

Bug Fixes

• Logger Improvements
  • Resolved an issue where previous loggers could be removed unintentionally. This fix ensures compatibility with other libraries, such as open-webui, that may configure their own loggers.

Commits details since the last release

• [31bf345] by @thiswillbeyourgithub, 89 seconds ago:
  bump version 2.6.8 -> 2.6.9

bumpver.toml
docs/source/conf.py
setup.py
wdoc/wdoc.py

• [adc6a44] by @thiswillbeyourgithub, 2 minutes ago:
  fix: do not remove previous logger
  they can be set by another lib, for example open-webui

Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/logger.py

Release 2.6.8

What's new

• Version Update

  • Bumped from version 2.6.7 to 2.6.8.

• New Features

  • Implementation to prevent crashes if torchaudio cannot be imported.

• Documentation

  • A new all_docs.rst file has been added for comprehensive documentation.
  • Mentioned availability of full documentation online in README.md.
  • Enhanced API documentation with infinite depth support.
  • Improved naming conventions for full documentation pages.
  • Added links directing users to all_docs and related pages.

• Fixes

  • Corrected erroneous links in documentation files.

• Minor Improvements

  • Added docstrings to facilitate code understanding.
  • Introduced type checking to additional functions in embeddings utils.
  • Adjusted usage to prefer vectorstore over faiss.

Commits details since the last release

• [950da9d] by @thiswillbeyourgithub, 11 minutes ago:
  bump version 2.6.7 -> 2.6.8

bumpver.toml
docs/source/conf.py
setup.py
wdoc/wdoc.py

• [cd8097c] by @thiswillbeyourgithub, 14 minutes ago:
  minor: add a docstring
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/import_tricks.py

• [3f8d58f] by @thiswillbeyourgithub, 16 minutes ago:
  new: don't crash if torchaudio can't be imported
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/import_tricks.py
wdoc/utils/loaders.py

• [2071086] by @thiswillbeyourgithub, 27 hours ago:
  mention the full doc is online
  Signed-off-by: thiswillbeyourgithub
  26625900+thiswillbeyourgithub@users.noreply.github.com

README.md

• [7efe787] by @thiswillbeyourgithub, 27 hours ago:
  fix link
  Signed-off-by: thiswillbeyourgithub
  26625900+thiswillbeyourgithub@users.noreply.github.com

docs/source/all_docs.rst

• [db312f4] by @thiswillbeyourgithub, 27 hours ago:
  minor
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

docs/source/all_docs.rst

• [8f77154] by @thiswillbeyourgithub, 27 hours ago:
  better name for the full doc page
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

docs/source/all_docs.rst

• [8677e43] by @thiswillbeyourgithub, 28 hours ago:
  add link to all_docs
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

docs/source/index.rst

• [4a68571] by @thiswillbeyourgithub, 30 hours ago:
  docs: add an all_docs.rst file
  Signed-off-by: thiswillbeyourgithub
  26625900+thiswillbeyourgithub@users.noreply.github.com

docs/source/all_docs.rst

• [f63abe8] by @thiswillbeyourgithub, 30 hours ago:
  docs: infinite depth for api.rst
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

docs/source/api.rst

• [975f0ff] by @thiswillbeyourgithub, 35 hours ago:
  use type vectorstore instead of faiss
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/embeddings.py

• [9b4ebd6] by @thiswillbeyourgithub, 35 hours ago:
  minor: add typechecking to 2 func
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/embeddings.py

Release 2.6.7

What's new

• fix litellm version needed a bump to have sonnet 3.7 prices
• fix examples

Commits details since the last release

• [55c329e] by @thiswillbeyourgithub, 2 minutes ago:
  bump version 2.6.6 -> 2.6.7

bumpver.toml
docs/source/conf.py
setup.py
wdoc/wdoc.py

• [cccba36] by @thiswillbeyourgithub, 3 minutes ago:
  fix: bump to litellm is needed to get sonnet 3.7 prices
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

setup.py

• [a28a1dd] by @thiswillbeyourgithub, 26 minutes ago:
  fix: outdated examples
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/docs/examples.md

Release 2.6.6

What's new

• add tags and user env variable
• experimental opt in auto refreshing env variables

Commits details since the last release

• [6d01207] by @thiswillbeyourgithub, 2 minutes ago:
  bump version 2.6.5 -> 2.6.6

bumpver.toml
docs/source/conf.py
setup.py
wdoc/wdoc.py

• [db3be93] by @thiswillbeyourgithub, 8 minutes ago:
  new: add experimntal opt in feature for auto refreshing env vars
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

tests/test_wdoc.py
wdoc/utils/env.py
wdoc/utils/misc.py

• [004970c] by @thiswillbeyourgithub, 78 minutes ago:
  fix: wrong type for docdict
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/env.py

• [2464055] by @thiswillbeyourgithub, 78 minutes ago:
  enh: parse none as None in env variable, same for true and false
  Signed-off-by: thiswillbeyourgithub
  26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/env.py

• [129ce0f] by @thiswillbeyourgithub, 2 hours ago:
  fix: typo
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/docs/help.md

• [9a33550] by @thiswillbeyourgithub, 2 hours ago:
  feat: add WDOC_LITELLM_USER env var too
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/docs/help.md
wdoc/utils/env.py
wdoc/utils/llm.py

• [407d9b7] by @thiswillbeyourgithub, 2 hours ago:
  feat: add WDOC_LITELLM_TAGS env variable. They are passed to litellm
  Signed-off-by: thiswillbeyourgithub
  26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/docs/help.md
wdoc/utils/env.py
wdoc/utils/llm.py

Release 2.6.5

What's new

• upgrade default model to sonnet 3.7
• fix bug that could happen in some environment where nested asyncio cannot be patched
• various test enhancements

Commits details since the last release

• [fb3941f] by @thiswillbeyourgithub, 3 minutes ago:
  bump version 2.6.4 -> 2.6.5

bumpver.toml
docs/source/conf.py
setup.py
wdoc/wdoc.py

• [ec913f8] by @thiswillbeyourgithub, 3 minutes ago:
  new: add script to run all the tests
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

tests/run_all_tests.sh

• [413406c] by @thiswillbeyourgithub, 31 minutes ago:
  bump litellm version to be sure it contains sonnet 3.7
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

setup.py

• [5bbeaea] by @thiswillbeyourgithub, 33 minutes ago:
  fix: add a try block around patching asyncio loop

wdoc/init.py

• [4d5a51a] by @thiswillbeyourgithub, 29 hours ago:
  change default model from openai 4o + 4o mini to sonnet 3.7 and haiku 3.5
  Signed-off-by: thiswillbeyourgithub
  26625900+thiswillbeyourgithub@users.noreply.github.com

README.md
wdoc/utils/env.py

• [3951b8e] by @thiswillbeyourgithub (aider), 3 days ago:
  feat: Add environment variable support for models selection

tests/test_wdoc.py

• [715b4d8] by @thiswillbeyourgithub, 4 days ago:
  fix test name
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

tests/test_wdoc.py

• [c6e5599] by @thiswillbeyourgithub, 4 days ago:
  test: fix to use artic embedding instead of bge
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

tests/test_wdoc.py

• [4183692] by @thiswillbeyourgithub (aider), 4 days ago:
  feat: Add test for parsing downloaded DOCX file using temporary file

tests/test_wdoc.py

• [66a3800] by @thiswillbeyourgithub, 4 days ago:
  minor: import order
  Signed-off-by: thiswillbeyourgithub
  26625900+thiswillbeyourgithub@users.noreply.github.com

tests/test_wdoc.py

• [a0d1e23] by @thiswillbeyourgithub (aider), 4 days ago:
  test: Add semantic batching test with diverse text inputs

tests/test_wdoc.py

• [ae5cd84] by @thiswillbeyourgithub (aider), 4 days ago:
  test: Add test for parsing NYTimes homepage URL

tests/test_wdoc.py
wdoc/docs/parse_file_help.md

• [d871d6c] by @thiswillbeyourgithub, 4 days ago:
  todo: mention usearch better than faiss
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

README.md

Release 2.6.4

What's new

• better dependencies management

Commits details since the last release

• [778c574] by @thiswillbeyourgithub, 3 minutes ago:
  bump version 2.6.3 -> 2.6.4

bumpver.toml
docs/source/conf.py
setup.py
wdoc/wdoc.py

• [d5ae021] by @thiswillbeyourgithub (aider), 8 minutes ago:
  refactor: Replace assertions with warning messages in docstring overloader

wdoc/utils/logger.py

• [c20c521] by @thiswillbeyourgithub, 10 minutes ago:
  fix: forgot to update manifest files for docs
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

MANIFEST.in

• [97307f5] by @thiswillbeyourgithub, 14 minutes ago:
  fix: revert the bumping of libs
  didn't add value but caused issues with open webui

Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

setup.py

• [365a6fd] by @thiswillbeyourgithub, 18 minutes ago:
  Revert "fix: dependencies"
  This reverts commit db9deaa.

setup.py

Release 2.6.3

What's new

• mostly major docs improvement

Commits details since the last release

• [e497ee9] by @thiswillbeyourgithub, 5 minutes ago:
  bump version 2.6.2 -> 2.6.3

bumpver.toml
docs/source/conf.py
setup.py
wdoc/wdoc.py

• [e068014] by @thiswillbeyourgithub, 62 minutes ago:
  tests: more --help tests
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

tests/test_wdoc.py

• [8f68b24] by @thiswillbeyourgithub, 63 minutes ago:
  docs: better docstring replacer
  Signed-off-by: thiswillbeyourgithub
  26625900+thiswillbeyourgithub@users.noreply.github.com
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/wdoc.py

• [45cdff5] by @thiswillbeyourgithub, 64 minutes ago:
  docs: better docstring replacer
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/logger.py

• [aace3ad] by @thiswillbeyourgithub, 2 hours ago:
  test: remove commented hf embeddings test

tests/test_wdoc.py

• [dc711f6] by @thiswillbeyourgithub, 12 hours ago:
  fix: calling parse file from python -m
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/main.py

• [bee9a96] by @thiswillbeyourgithub, 13 hours ago:
  add twine and build to the wdoc dev
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

setup.py