🚀 Bytecode VM#93

Merged

timfennis merged 193 commits intomasterfrom

feature/bytecode-vm

Mar 21, 2026

Commits on Mar 21, 2026

✨ Add ndc_vm crate skeleton for bytecode VM
timfennis
committed
📚 Chapter 14 + 15
timfennis
committed
🚧 WIP bytecode VM compiler and chunk
timfennis
committed
New Value type for the VM, and constant compilation
timfennis
committed
WIP
timfennis
committed
Fix warnings
timfennis
committed
Basic conditions implemented
timfennis
committed
Make function definition expression contain a signature instead of expressions
timfennis
committed
Add tests for the compiler output
timfennis
committed
Add disassembling functionality
timfennis
committed
🌍 Add GetGlobal opcode and wire up Call instruction in the VM
timfennis
committed
🔧 Bridge stdlib globals into VM and fix locals to use the stack
timfennis
committed
🔀 Add runtime dynamic dispatch for overloaded functions in the VM
timfennis
committed
Fix compilation of return opcodes
timfennis
committed
✅ Fix Statement/Block compilation and add compiler tests
timfennis
committed
♻️ Add Value::unit() constructor and use it in the compiler
timfennis
committed
♻️ Extract dispatch_call to remove duplicated Call logic
timfennis
committed
✅ Run tests against both tree-walk and VM interpreter
timfennis
committed
🔌 Wire VM print output to the interpreter's captured buffer
timfennis
committed
🏗️ Make declarations pure statements and fix VM local variable stack layout
timfennis
committed
🔍 Add vm-trace feature for source-annotated instruction tracing
timfennis
committed
💥 Add todo!() panics for unimplemented compiler branches
timfennis
committed
🧹 Move vm-trace ip capture inside cfg block, suppress unused param warning
timfennis
committed
Benchmark tool + tuple and list support
timfennis
committed
⚡ Pre-allocate stack and avoid to_vec() on native calls
timfennis
committed
Upvalue WIP + cargo fmt
timfennis
committed
🔒 Implement closure capture and upvalue resolution in the VM
timfennis
committed
📦 Make VM lists reference-counted and sync mutations through the bridge
timfennis
committed
🏗️ Pre-allocate locals at function entry to fix stack corruption
timfennis
committed
Make [] indexing a function call (#94)
timfennis
committed
Cargo fmt
timfennis
committed
🔄 Add FunctionBody::Opaque to round-trip VM functions through the interpreter
timfennis
committed
WIP
timfennis
committed
WIP on upvalue hoisting in the analyzer
timfennis
committed
🚧 Analyser-side upvalue hoisting (steps 1-4 of PLAN_upvalue_mutation.md)
timfennis
committed
✅ Fix upvalue mutation and iteration scope transparency

timfennis
and
claude
committed
♻️ Split compiler tests into separate crate

timfennis
and
claude
committed
✅ Implement analyser-side upvalue hoisting in the VM (steps 5 & 6)

timfennis
and
claude
committed
Remove completed plan
timfennis
committed
🔍 Replace unreachable todo in FunctionDeclaration compiler

timfennis
and
claude
committed
Add nested break/continue test cases

timfennis
and
claude
committed
Refactor VM compiler for readability

timfennis
and
claude
committed
Implement break/continue in VM compiler and add vm-ready markers

timfennis
and
claude
committed
Simplify compile_while by returning loop_start from new_loop_context

timfennis
and
claude
committed
Implement op-assignment for identifier lvalues

timfennis
and
claude
committed
✅ Fix VM return-outside-function error and function equality

timfennis
and
claude
committed
✅ Implement index assignment via stdlib []= function call

timfennis
and
claude
committed
✅ Mark string index assignment tests as vm-ready

timfennis
and
claude
committed
✅ Mark 3 more passing VM tests as vm-ready

timfennis
and
claude
committed
✅ Implement for-loops, ranges, and iterators in the bytecode VM

timfennis
and
claude
committed
✅ Fix compiler test + mark 14 more tests as vm-ready

timfennis
and
claude
committed
♻️ Refactor iteration_local_slot helper in analyser

timfennis
and
claude
committed
✅ Implement op-assign index (x[i] += v) in the bytecode VM

timfennis
and
claude
committed
✅ Implement tuple destructuring (Unpack opcode) in the bytecode VM

timfennis
and
claude
committed
✅ Enable VM closure callbacks from stdlib HOFs (map, filter, fold, all, etc.)

timfennis
and
claude
committed
✅ Mark 6 more tests as vm-ready

timfennis
and
claude
committed
🐛 Fix two regressions introduced by HOF callback commit

timfennis
and
claude
committed
🐛 Fix sequence op-assignment error handling
timfennis
committed
✅ Implement index assignment in destructuring (compile_lvalue)
timfennis
committed
✅ Implement map literals in VM compiler

timfennis
and
claude
committed
✅ Add proper error handling for non-iterable values in VM

timfennis
and
claude
committed
🔄 Narrow VM error spans for for-loop sequences

timfennis
and
claude
committed
⬜ Narrow spans on synthetic VM opcodes

timfennis
and
claude
committed
✅ Propagate stdlib errors from VM native functions

timfennis
and
claude
committed
✅ Implement destructuring and map iteration in VM for-loops

timfennis
and
claude
committed
🔧 Fix compiler warnings and mark 11 more tests vm-ready

timfennis
and
claude
committed
✅ Support string destructuring in VM and improve unpack error messages

timfennis
and
claude
committed
✅ Add test for invalid string destructuring and unify unpack error messages

timfennis
and
claude
committed
🔧 Refactor vm.rs for readability

timfennis
and
claude
committed
✅ Type-check bool conditions in VM JumpIfFalse/JumpIfTrue

timfennis
and
claude
committed
✅ Mark 038_invalid_if_gaurd_in_comprehension as vm-ready

timfennis
and
claude
committed
✅ Fix closure-over-loop-variable and mark 041/014 as vm-ready

timfennis
and
claude
committed
✅ Fix tuple range slicing in VM (042_unit_is_tuple)

timfennis
and
claude
committed
✅ Fix Hash/PartialEq mismatch for VM-bridged function values (007/005)

timfennis
and
claude
committed
✅ Mark 009_slicing 003/004/006 as vm-ready

timfennis
and
claude
committed
✅ Fix op-assign on map values; mark 007/018 as vm-ready

timfennis
and
claude
committed
✅ Implement map/set comprehensions in VM; fix accumulator slot with destructuring

timfennis
and
claude
committed
✅ Implement MinHeap, MaxHeap, Deque in VM; fix None identifier in compiler

timfennis
and
claude
committed
Fix int/float comparison tiebreaker in VM; add ordering edge-case tests

timfennis
and
claude
committed
✅ Cover cross-type numeric ordering gaps in VM OrdValue

timfennis
and
claude
committed
Expand CLAUDE.md with commands and architecture overview

timfennis
and
claude
committed
Implement unbounded range (start..) in bytecode VM

timfennis
and
claude
committed
Mark slicing and deque indexing tests as vm-ready

timfennis
and
claude
committed
Fix upvalue access in transparent iteration scopes

timfennis
and
claude
committed
✅ VM op-assign: use in-place path when resolved_assign_operation matches; add List/Map identity keys

timfennis
and
claude
committed
Implement memoization for pure fn in the bytecode VM

timfennis
and
claude
committed
Implement vectorized tuple math in the bytecode VM

timfennis
and
claude
committed
Fix unbalanced if as expression: always yields a value (unit when false)

timfennis
and
claude
committed
fix indentation in test
timfennis
committed
VM: return error instead of panicking when calling a non-function value

timfennis
and
claude
committed
Fix big_int_ranges: return error instead of panicking, improve message

timfennis
and
claude
committed
Fix weird_iterator_cloning VM test; remove borrow_mut test

timfennis
and
claude
committed
Remove // vm-ready markers; all VM tests run by default

timfennis
and
claude
committed
Fix two VM bugs: open upvalues and destructive list unpack (#104)

timfennis
and
claude
committed
Phase 0: update CLAUDE.md and remove stale // vm-ready comments

timfennis
and
claude
committed
Phase 1: add vm_native field to Function for bridge-free dispatch

timfennis
and
claude
committed
Migrate arithmetic operators to VM-native dispatch

timfennis
and
claude
committed
Migrate comparison and boolean operators to VM-native dispatch

timfennis
and
claude
committed
Add VM-native dispatch for trig/math functions; add trig test coverage

timfennis
and
claude
committed
export_module: auto-generate vm_native for simple-typed functions

timfennis
and
claude
committed
Extend export_module macro: auto vm_native for &str, String, i64 types

timfennis
and
claude
committed
Inverted bridge: VmNative body for stdlib; migrate list/index/value/sequence

timfennis
and
claude
committed
Refactor: Rc<Object> replaces Box<Object>; flatten inner Rc from mutable variants

timfennis
and
claude
committed
Migrate deque/heap/map stdlib to VmNative; add VecDeque/BinaryHeap/HashMap macro support

timfennis
and
claude
committed
Migrate list ++/++=, is_some/is_none, max/min to VmNative

timfennis
and
claude
committed
Fix VM slot collision in nested list/map comprehensions

timfennis
and
claude
committed
Change NativeFunction error type from String to VmError

timfennis
and
claude
committed
Fix sort() being a no-op in the tree-walk interpreter

timfennis
and
claude
committed
Migrate stdlib Sequence params to VM-native SeqValue; fix VM Int/Float equality

timfennis
and
claude
committed
Optimize VM HOF dispatch with two-tier NativeFunc enum

timfennis
and
claude
committed
Migrate cmp/math/regex stdlib to VM-native types; fix cross-type numeric equality

timfennis
and
claude
committed
Migrate rand/sequence/value stdlib to VM-native types; add VM RepeatIter + deepcopy

timfennis
and
claude
committed
Migrate serde stdlib to VM-native types

timfennis
and
claude
committed
Fix -= operator display for sets and add test

timfennis
and
claude
committed
Fix op-assign dynamic dispatch for maps, strings, and lists

timfennis
and
claude
committed
Migrate string ++= to VM-native return type; add Value::from_string_rc

timfennis
and
claude
committed
Migrate hash_map stdlib to VM-native types; add MapValue type alias

timfennis
and
claude
committed
add git info to CLAUDE.md
timfennis
committed
Migrate string.rs: replace ndc_interpreter::sequence::StringRepr import

timfennis
and
claude
committed
Add VM output support and wire print/dbg to VM-native path

timfennis
and
claude
committed
Migrate list stdlib inner module to VM-native types

timfennis
and
claude
committed
Replace ndc_interpreter::num/int with ndc_core in math stdlib

timfennis
and
claude
committed
Replace ndc_interpreter::num/compare with ndc_core in rand and sequence

timfennis
and
claude
committed
Remove tree-walk interpreter; make VM the only execution path

timfennis
and
claude
committed
Update bench.sh to reflect VM-only execution

timfennis
and
claude
committed
Add error type prefix to diagnostic messages

timfennis
and
claude
committed
Add persistent REPL VM with resume-from-halt support

timfennis
and
claude
committed
Print REPL expression results; silence statements and unit

timfennis
and
claude
committed
Delete GenericFunction interpreter paths from stdlib

timfennis
and
claude
committed
Move StaticType from ndc_parser to ndc_core

timfennis
and
claude
committed
Fix build after moving StaticType to ndc_core

timfennis
and
claude
committed
Fix missing Value import in ndc_vm/src/value/function.rs
timfennis
committed
Move ndc_vm/src/value.rs to ndc_vm/src/value/mod.rs
timfennis
committed
Apply formatting from cargo fmt
timfennis
committed
🔧 Adjust imports and add FunctionRegistry skeleton
timfennis
committed
Replace Environment-based function registry with FunctionRegistry<Rc<NativeFunction>>

timfennis
and
claude
committed
Fix docs command and improve function return type annotations

timfennis
and
claude
committed
Add 10k recursion depth test
timfennis
committed
Fix pi_approx benchmark: move float conversion inside function
timfennis
committed
Rewrite docs with pretty output and --no-color flag, migrate to yansi

timfennis
and
claude
committed
Remove duplicate tree-walk test variants; update CLAUDE.md

timfennis
and
claude
committed
Perf: add int/float fast paths in PartialOrd, use with_context in rand

timfennis
and
claude
committed
Perf: cache StaticType on CompiledFunction, inline vectorized calls, fix fade memoization

timfennis
and
claude
committed
Perf: zero-alloc overload matching, skip upvalue materialization for Simple natives

timfennis
and
claude
committed
Bench: increase fibonacci to fib(26), sieve to 200k

timfennis
and
claude
committed
Refactor: remove tree-walk evaluator, Environment, and dead macro infrastructure

timfennis
and
claude
committed
Refactor: remove vm_bridge, interpreter Value type, and all bridge modules

timfennis
and
claude
committed
Cleanup: remove as_any from VmIterator, Vm::stub, stale bridge comments

timfennis
and
claude
committed
Refactor: extract ndc_analyser crate, remove WithStdlib trait

timfennis
and
claude
committed
Bump version to 0.3.0
timfennis
committed
Refactor: simplify output, decouple ndc_lsp from ndc_stdlib

timfennis
and
claude
committed
Add benchmarks, fix quicksort/sieve, update bench.sh for version comparison

timfennis
and
claude
committed
Fix: upvalue dispatch in overload sets, precise container static types

timfennis
and
claude
committed
Perf: add Value::is_number, avoid O(n) static_type in hot path

timfennis
and
claude
committed
Perf: borrow opcode by ref in dispatch loop, ~4-8% speedup

timfennis
and
claude
committed
Fix: map default function called when key is missing

timfennis
and
claude
committed
Perf: skip static_type() for Any params in overload dispatch (~6-8%)

timfennis
and
claude
committed
Docs: document memoization key cost and upvalue pattern
timfennis
committed
Fix: B1/B2/B3 — convert panics and overflows to VmErrors

timfennis
and
claude
committed
Fix: B5 — delete materialize_upvalues_in_args

timfennis
and
claude
committed
Perf: P3/P4/P5 — close_upvalues single pass, vectorization deferred alloc, borrow candidates

timfennis
and
claude
committed
Fix: O(N) dynamic dispatch for container params in overload resolution

timfennis
and
claude
committed
Docs: fix manual spelling, grammar, and factual errors

timfennis
and
claude
committed
Perf: P7 — MapIter clones keys only, borrows values on demand

timfennis
and
claude
committed
Feat: lazy combinations and take iterators

timfennis
and
claude
committed
Refactor: eval() returns Value, re-export NativeFunction

timfennis
and
claude
committed
Fix: B4 — UnboundedRangeIter overflow at i64::MAX

timfennis
and
claude
committed
Fix: B6 — resolve_callee returns VmError instead of panicking

timfennis
and
claude
committed
Fix: analyser rejects calling non-function types

timfennis
and
claude
committed
Refactor: R5 — remove RefCell from VmCallable

timfennis
and
claude
committed
Refactor: M1, M2, RD1–RD4 from code review

timfennis
and
claude
committed
Add documentation to all manually registered stdlib functions

timfennis
and
claude
committed
Add docs to all undocumented stdlib functions, fix spelling, add docs() builtin

timfennis
and
claude
committed
Remove obsolete design documents

timfennis
and
claude
committed
Refactor ndc_macros: rename match→types, add NdcType enum, remove fully-qualified Value paths

timfennis
and
claude
committed
Collect TODOs into TODO.md, remove from source, add CLAUDE.md rule

timfennis
and
claude
committed
Clean up ndc_vm: deduplicate code, cache unit value, use references in hot paths

timfennis
and
claude
committed
Add ndc_analyser code review notes

timfennis
and
claude
committed
Deduplicate ndc_analyser: scope-walk helpers, fold_lub, merge lvalue resolvers

timfennis
and
claude
committed
Small cleanups in ndc_analyser: unreachable!, stale comments, docs

timfennis
and
claude
committed
Merge triple scope walk into single-pass resolve_function_binding

timfennis
and
claude
committed
Fix function overload resolution across closure boundaries, add redefinition error

timfennis
and
claude
committed
Pass actual types when resolving index operators [] and []=

timfennis
and
claude
committed
Function calls skip non-callable bindings, fix return type inference

timfennis
and
claude
committed
Add StaticType::Never for diverging expressions, fix lub(Int, unit) = Any

timfennis
and
claude
committed
⚡ Skip close_upvalues when no open upvalues; use Vec::new() for empty upvalues

timfennis
and
claude
committed
📝 Improve README examples

timfennis
and
claude
committed
Convert accumulator_slot .expect() panics to CompileErrors

timfennis
and
claude
committed
Convert ListPush and MapInsert panics to VmErrors

timfennis
and
claude
committed
Embed git commit hash in --version output

timfennis
and
claude
committed
Add memory management page to manual

timfennis
and
claude
committed
📎 clippy fixes
timfennis
committed
📎 Fix all clippy warnings, add &mut [T] macro support

timfennis
and
claude
committed