|
2 | 2 |
|
3 | 3 | ## Done |
4 | 4 |
|
5 | | -Everything below is shipped, tested, and on `dev`. |
6 | | - |
7 | 5 | - **Core**: TrainingEnv/InferenceEnv interfaces, auto-config (`env.train('dqn')`), IgnitionEnv with train/infer/stop |
8 | 6 | - **Algos**: DQN, PPO, Q-Table — all with greedy mode for inference |
9 | | -- **Infrastructure**: pnpm monorepo, Zod validation, ring buffer, backend selector |
| 7 | +- **Infrastructure**: pnpm monorepo, Zod validation, CI/CD (GitHub Actions), `ignitionai` umbrella package |
10 | 8 | - **ONNX**: OnnxAgent, TF.js→ONNX exporter, HF Hub loader |
11 | 9 | - **Storage**: HuggingFace Hub provider (save/load/list/delete) |
12 | | -- **Demos**: GridWorld, CartPole, MountainCar — train + inference mode, live reward chart |
13 | | -- **Tests**: 149 passing across all packages |
| 10 | +- **Environments**: `@ignitionai/environments` — GridWorld, CartPole, MountainCar |
| 11 | +- **Demos 2D**: GridWorld, CartPole, MountainCar — train + inference mode, live reward chart |
| 12 | +- **Demo 3D**: CartPole 3D (R3F) — metallic cart, pole, rail, professional lighting |
| 13 | +- **184+ tests** passing across all packages |
14 | 14 |
|
15 | 15 | --- |
16 | 16 |
|
17 | | -## Phase 1 — Ship It (npm publish + CI/CD) |
| 17 | +## Phase 1 — Wow Demo: Car on Circuit (IN PROGRESS) |
18 | 18 |
|
19 | | -> Nobody can use IgnitionAI if they can't install it. |
| 19 | +> A 3D car learns to drive on a circuit. The hero demo. |
20 | 20 |
|
21 | | -- [ ] CI/CD: GitHub Actions — tests + build on every PR, block merge on failure |
22 | | -- [ ] npm publish: `@ignitionai/core`, `@ignitionai/backend-tfjs`, `@ignitionai/backend-onnx`, `@ignitionai/storage` |
23 | | -- [ ] Extract environments into `@ignitionai/environments` package (GridWorld, CartPole, MountainCar with TrainingEnv interface) |
24 | | -- [ ] Publish environments to npm |
25 | | -- [ ] Version 0.1.0 — first public release |
26 | | -- [ ] CHANGELOG.md |
| 21 | +- [ ] Car on oval circuit with R3F + 3D model (.glb) |
| 22 | +- [ ] Discrete actions: steer left, straight, steer right |
| 23 | +- [ ] Observation: car position, angle, distance to track edges, velocity |
| 24 | +- [ ] Agent learns to stay on track and complete laps |
| 25 | +- [ ] Train → Inference toggle — car drives perfectly after training |
| 26 | +- [ ] Deploy on Vercel as shareable URL |
27 | 27 |
|
28 | | -## Phase 2 — The Wow Demo (3D + Physics) |
| 28 | +## Phase 2 — Landing Page & Docs |
29 | 29 |
|
30 | | -> One killer R3F demo that makes people share it. |
| 30 | +> Convert visitors into users. |
31 | 31 |
|
32 | | -- [ ] CartPole 3D: React Three Fiber + Rapier physics — cart on rail, pole balancing, camera follows |
33 | | -- [ ] Train in browser → switch to inference → pole stays perfectly balanced in 3D |
34 | | -- [ ] Deploy as a standalone page on Vercel/Netlify — shareable URL |
35 | | -- [ ] This becomes the homepage hero demo |
| 32 | +- [ ] Landing page: hero demo embed, "10 lines of code" pitch, install command |
| 33 | +- [ ] Documentation site: Getting Started, TrainingEnv API, algorithm guide, ONNX export |
| 34 | +- [ ] README updated with badges, quickstart pointing to docs |
36 | 35 |
|
37 | | -## Phase 3 — Landing Page & Docs |
| 36 | +## Phase 3 — Advanced Algorithms |
38 | 37 |
|
39 | | -> Convert visitors into users. |
| 38 | +> Continuous action spaces for real game AI. |
40 | 39 |
|
41 | | -- [ ] Landing page: hero demo (3D CartPole), "10 lines of code" pitch, install command, 3 demo links |
42 | | -- [ ] Documentation site: Getting Started, TrainingEnv API reference, algorithm guide, ONNX export guide |
43 | | -- [ ] README updated with badges, install command, quickstart pointing to docs |
44 | | -- [ ] SEO: "reinforcement learning javascript", "ml-agents alternative", "train AI browser" |
| 40 | +- [ ] SAC (Soft Actor-Critic) — continuous steering angle, throttle |
| 41 | +- [ ] Upgrade car demo to continuous actions with SAC |
| 42 | +- [ ] A2C — lightweight alternative to PPO |
45 | 43 |
|
46 | | -## Phase 4 — Advanced Algorithms |
| 44 | +## Phase 4 — Ecosystem & Growth |
47 | 45 |
|
48 | | -> Continuous action spaces unlock real game AI use cases. |
| 46 | +> Scale adoption. |
49 | 47 |
|
50 | | -- [ ] Discussion: DDPG vs SAC vs TD3 — which first? (SAC recommended: more stable, entropy-regularized) |
51 | | -- [ ] SAC: Soft Actor-Critic for continuous action spaces (e.g. steering angle, throttle) |
52 | | -- [ ] Navigation 2D demo: continuous actions, obstacle avoidance — proves SAC works |
53 | | -- [ ] A2C: lightweight alternative to PPO for simpler problems |
| 48 | +- [ ] npm publish v0.1.0 (all packages + umbrella) |
| 49 | +- [ ] Example gallery: Three.js, R3F, vanilla canvas, Node.js headless |
| 50 | +- [ ] ONNX deployment guides: Unity (Sentis), Unreal (NNE) |
| 51 | +- [ ] `create-ignitionai-app` starter template |
| 52 | +- [ ] Blog post / Twitter launch |
| 53 | + |
| 54 | +--- |
54 | 55 |
|
55 | | -## Phase 5 — Ecosystem & Growth |
| 56 | +## Optional — Showcase Demos |
56 | 57 |
|
57 | | -> Make it easy to adopt, contribute, and build on. |
| 58 | +> Additional 3D demos for the gallery. Build when time allows. |
58 | 59 |
|
59 | | -- [ ] Example gallery: 5+ examples (Three.js, R3F, vanilla canvas, Node.js headless) |
60 | | -- [ ] ONNX deployment guide: step-by-step for Unity (Sentis), Unreal (NNE), Python |
61 | | -- [ ] Community templates: `create-ignitionai-app` starter |
62 | | -- [ ] Blog post / Twitter thread announcing the project |
63 | | -- [ ] Performance benchmarks: training speed on different backends (WebGPU vs WebGL vs CPU) |
| 60 | +- [ ] **Drone hover** — 3D drone learns to stabilize mid-air (thrust 4 directions) |
| 61 | +- [ ] **Marble on tilting platform** — tilt to guide a ball to the target |
| 62 | +- [ ] **Rocket landing** — SpaceX-style inverted pendulum in 3D (thrust 4 directions) |
| 63 | +- [ ] **Robot arm** — pick & place with joint rotations |
| 64 | +- [ ] **Snake 3D** — classic snake game rendered in R3F |
64 | 65 |
|
65 | 66 | --- |
66 | 67 |
|
|
0 commit comments