Bill Holcombe
dc8494bb2a
Fix all four Phase 1 correctness bugs (dynamic buffer, DLPack ownership, thread safety, padding)
...
- 1.1: Remove hardcoded 4096*512 buffer from PinnedBatcher; allocate host+device per-call
- 1.2: Wrap CudaSlice in DLPackContext owned by DLManagedTensor.manager_ctx; deleter frees
device memory when PyTorch releases tensor — no more silent overwrite across calls
- 1.3: batch_encode_to_gpu now takes &self (no mutable shared state); TokenizerEngine wraps
Arc<PinnedBatcher> and encode_batch takes &self — safe for concurrent Python threads
- 1.4: seq_len = max across all encodings; host buffer prefilled with pad_id before token write
Also: switch cudarc gpu feature from cuda-version-from-build-system to cuda-12050 to fix
build on machines with CUDA 13.x (cudarc 0.11.9 only knows up to 12.5)
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com >
2026-04-21 14:10:31 -06:00
f8ad40d302
made zero-copy JSON - shared memory logic
2026-02-11 06:29:08 +00:00
BillTheMaker
c97f5e6e6e
Merge pull request #10 from BillTheMaker/feature
...
feature
2025-11-25 13:15:10 -07:00
Bill
c734fadba2
Apache license
2025-11-25 11:05:12 -07:00
Bill
0b0f3677b1
version update to publish to Pypi 7
Publish to PyPI / Build wheels on macos-latest (push) Has been cancelled
Publish to PyPI / Build wheels on ubuntu-latest (push) Has been cancelled
Publish to PyPI / Build wheels on windows-latest (push) Has been cancelled
Publish to PyPI / Publish to PyPI (push) Has been cancelled
2025-11-23 13:46:17 -07:00
Bill
5313f5f4ef
version update to publish to Pypi 6
Publish to PyPI / Build wheels on macos-latest (push) Has been cancelled
Publish to PyPI / Build wheels on ubuntu-latest (push) Has been cancelled
Publish to PyPI / Build wheels on windows-latest (push) Has been cancelled
Publish to PyPI / Publish to PyPI (push) Has been cancelled
2025-11-23 13:34:19 -07:00
Bill
72974a9658
version update to publish to Pypi 5
Publish to PyPI / Build wheels on macos-latest (push) Has been cancelled
Publish to PyPI / Build wheels on ubuntu-latest (push) Has been cancelled
Publish to PyPI / Build wheels on windows-latest (push) Has been cancelled
Publish to PyPI / Publish to PyPI (push) Has been cancelled
2025-11-23 13:27:58 -07:00
Bill
8981b3038d
version update to publish to Pypi 5
2025-11-23 13:27:22 -07:00
Bill
751b95a123
version update to publish to Pypi 4
Publish to PyPI / Build wheels on macos-latest (push) Has been cancelled
Publish to PyPI / Build wheels on ubuntu-latest (push) Has been cancelled
Publish to PyPI / Build wheels on windows-latest (push) Has been cancelled
Publish to PyPI / Publish to PyPI (push) Has been cancelled
2025-11-23 13:07:02 -07:00
Bill
26d1eb631e
version update to publish to Pypi 2
Publish to PyPI / Build wheels on macos-latest (push) Has been cancelled
Publish to PyPI / Build wheels on ubuntu-latest (push) Has been cancelled
Publish to PyPI / Build wheels on windows-latest (push) Has been cancelled
Publish to PyPI / Publish to PyPI (push) Has been cancelled
2025-11-23 12:53:54 -07:00
Bill
d6bd2eee00
version update to publish to Pypi
Publish to PyPI / Build wheels on macos-latest (push) Has been cancelled
Publish to PyPI / Build wheels on ubuntu-latest (push) Has been cancelled
Publish to PyPI / Build wheels on windows-latest (push) Has been cancelled
Publish to PyPI / Publish to PyPI (push) Has been cancelled
2025-11-23 12:45:31 -07:00
Bill
c338fcae65
make tracy optional, add readme.md, continue fixing thrashing for sequential reads for workers
2025-11-22 22:11:08 -07:00
Bill
9525aa8878
profiler set up! cpu starvation identified
2025-11-19 11:04:31 -07:00
Bill
e041912108
freeze state, no good
2025-11-18 20:51:03 -07:00
Bill
791a9bfc49
added explicit chrono-tz version
2025-11-18 19:30:43 -07:00
Bill
dd258a71ff
fixed chronotz Git pypi build deploy error
2025-11-18 18:38:33 -07:00
Bill
ac61f58f01
optimizing hardware limits in Rust
2025-11-18 12:40:08 -07:00
Bill
b2224a15b8
debugged parallelization logic
2025-11-18 09:59:49 -07:00
c42ce75c46
Update Cargo.toml via mobile
2025-11-17 22:58:09 -07:00
Bill
9acfc919b8
improving efficiency and writing to file
2025-11-17 18:49:57 -07:00
Bill
d84e52a9f3
improving efficiency and writing to file
2025-11-17 16:22:54 -07:00
Bill
ef8f0d8b96
Initial commit
2025-11-17 14:23:03 -07:00
