Skip to content

Create a CLI  #3

@joshcarp

Description

@joshcarp
  • A user-friendly interactive command-line interface, similar to ollama
  • Use cobra or charm.sh

Flags:
To start with it would only need a --prompt flag, then interactive chat style would be a further goal

After the simple --prompt flag, it would be nice to be able to extract information like token loss, perplexity, and any other information that can be extracted

  • --temperature
  • --batch-size controls size of batch size, larger would lead to quicker passes
  • --training-data would specify training data to open
  • --eval-data would specify data to eval against

See https://github.com/joshcarp/grpctl for reference

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions