Bill Holcombe
dc8494bb2a
Fix all four Phase 1 correctness bugs (dynamic buffer, DLPack ownership, thread safety, padding)
...
- 1.1: Remove hardcoded 4096*512 buffer from PinnedBatcher; allocate host+device per-call
- 1.2: Wrap CudaSlice in DLPackContext owned by DLManagedTensor.manager_ctx; deleter frees
device memory when PyTorch releases tensor — no more silent overwrite across calls
- 1.3: batch_encode_to_gpu now takes &self (no mutable shared state); TokenizerEngine wraps
Arc<PinnedBatcher> and encode_batch takes &self — safe for concurrent Python threads
- 1.4: seq_len = max across all encodings; host buffer prefilled with pad_id before token write
Also: switch cudarc gpu feature from cuda-version-from-build-system to cuda-12050 to fix
build on machines with CUDA 13.x (cudarc 0.11.9 only knows up to 12.5)
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com >
2026-04-21 14:10:31 -06:00
Bill Holcombe
6f8b6440aa
Add roadmap, commercialization strategy, talk outline, and handoff notes
...
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com >
2026-04-21 11:13:17 -06:00
f8ad40d302
made zero-copy JSON - shared memory logic
2026-02-11 06:29:08 +00:00
Bill
409363bf80
Merge remote-tracking branch 'origin/main'
2026-02-09 16:25:35 -07:00
Bill
6d3a7f0b48
updated markdown
2026-02-09 16:25:23 -07:00
BillTheMaker
bb4bc1ec57
Enhance publish workflow for multi-OS support
...
Updated GitHub Actions workflow to support multiple OS builds and simplified wheel upload process.
2025-12-12 15:09:11 -07:00
Bill
a9ff2f1e76
readme move to parent folder
2025-12-12 14:32:22 -07:00
Bill
7c394c012d
pyproject.toml update
2025-12-12 14:26:27 -07:00
Bill
d690b08486
readme name update
2025-12-12 14:21:27 -07:00
Bill
4088471885
pyproject.toml version issues
2025-12-12 14:15:11 -07:00
BillTheMaker
f085e977e6
Refactor GitHub Actions for wheel publishing
...
Updated GitHub Actions workflow to build and publish Python wheels. Removed unnecessary jobs and streamlined the process for better efficiency.
2025-12-12 13:51:47 -07:00
333f8f0f26
Update pyproject.toml
2025-12-11 17:39:59 -07:00
9845e81194
Create publish2.yml
2025-12-11 17:39:15 -07:00
BillTheMaker
ed40391f93
Fix token variable for PyPI upload in workflow
2025-12-06 20:17:38 -07:00
BillTheMaker
e76d7a0a5b
Refactor wheel copying and upload process in CI
2025-12-06 20:11:44 -07:00
BillTheMaker
feff63fb36
Modify publish.yml to flatten wheel uploads
...
Updated the publish workflow to create a flattened directory for wheels before copying them.
2025-12-06 20:06:43 -07:00
BillTheMaker
0994b6656e
Clarify wheel flattening in publish.yml
...
Added comments to clarify the wheel flattening process.
2025-12-06 20:00:44 -07:00
BillTheMaker
e5f1dcf7b9
Refactor GitHub Actions workflow for building wheels
2025-12-06 19:52:07 -07:00
BillTheMaker
4fb0b78a5f
Refactor publish job in GitHub Actions workflow
...
Removed conditional checks and dependencies in the publish job.
2025-12-06 19:35:49 -07:00
BillTheMaker
15da5eb1c2
Refactor publish step in GitHub Actions workflow
2025-12-06 19:32:08 -07:00
BillTheMaker
f9ecbae6a4
Refactor publish workflow for PyPI
2025-12-06 19:30:14 -07:00
BillTheMaker
000a2fad3a
Update publish.yml
2025-12-06 19:25:47 -07:00
BillTheMaker
14b0481d7c
Fix Python version and clean up publish workflow
...
Updated Python version to 3.12 and removed invalid input for python in the build step.
2025-12-06 19:12:47 -07:00
BillTheMaker
bd8e07fe9c
Fix indentation in publish.yml workflow steps
2025-12-06 18:52:39 -07:00
BillTheMaker
9016b9213e
Update publish.yml
2025-12-06 18:48:02 -07:00
BillTheMaker
b25a070d5e
Add step to publish package to PyPI
2025-12-06 18:28:52 -07:00
BillTheMaker
8e6b120e76
Update publish workflow with debugging steps
2025-12-06 18:07:01 -07:00
BillTheMaker
ebea27b62e
Change pypi-token to token in publish.yml
2025-12-06 17:52:20 -07:00
BillTheMaker
09b4eb4510
Enhance publish workflow with wheel verification
...
Added steps to verify and flatten wheels before publishing.
2025-12-06 17:30:54 -07:00
BillTheMaker
30d741b418
Update publish workflow to allow manual triggering
2025-12-06 16:19:02 -07:00
BillTheMaker
7b5e615c00
Refactor publish.yml for matrix configuration
...
updating and fixing pypy documentation
2025-12-06 16:05:36 -07:00
BillTheMaker
056fbbb6e1
Update artifact name to include OS and target
2025-12-06 16:00:32 -07:00
BillTheMaker
c408c483d0
disable manylinux
...
disabled manylinux because it was defaulting to python 3.8 which was breaking Pypi build
2025-12-06 15:38:47 -07:00
BillTheMaker
c97f5e6e6e
Merge pull request #10 from BillTheMaker/feature
...
feature
2025-11-25 13:15:10 -07:00
Bill
50ddaacbdc
Apache license
2025-11-25 11:28:02 -07:00
Bill
c734fadba2
Apache license
2025-11-25 11:05:12 -07:00
Bill
258f7e09aa
configurable batch size for hardware optimizations
2025-11-25 01:14:45 -07:00
Bill
2811d97c47
fixed task switching latency and implemented string killer
2025-11-25 00:01:41 -07:00
BillTheMaker
9cacb95b0f
Merge pull request #9 from BillTheMaker/feature
...
add doc file
2025-11-24 20:18:09 -07:00
Bill
11ddd184f4
version update to publish to Pypi 7
2025-11-24 20:17:03 -07:00
Bill
0b0f3677b1
version update to publish to Pypi 7
Publish to PyPI / Build wheels on macos-latest (push) Has been cancelled
Publish to PyPI / Build wheels on ubuntu-latest (push) Has been cancelled
Publish to PyPI / Build wheels on windows-latest (push) Has been cancelled
Publish to PyPI / Publish to PyPI (push) Has been cancelled
2025-11-23 13:46:17 -07:00
Bill
5313f5f4ef
version update to publish to Pypi 6
Publish to PyPI / Build wheels on macos-latest (push) Has been cancelled
Publish to PyPI / Build wheels on ubuntu-latest (push) Has been cancelled
Publish to PyPI / Build wheels on windows-latest (push) Has been cancelled
Publish to PyPI / Publish to PyPI (push) Has been cancelled
2025-11-23 13:34:19 -07:00
Bill
72974a9658
version update to publish to Pypi 5
Publish to PyPI / Build wheels on macos-latest (push) Has been cancelled
Publish to PyPI / Build wheels on ubuntu-latest (push) Has been cancelled
Publish to PyPI / Build wheels on windows-latest (push) Has been cancelled
Publish to PyPI / Publish to PyPI (push) Has been cancelled
2025-11-23 13:27:58 -07:00
Bill
8981b3038d
version update to publish to Pypi 5
2025-11-23 13:27:22 -07:00
Bill
751b95a123
version update to publish to Pypi 4
Publish to PyPI / Build wheels on macos-latest (push) Has been cancelled
Publish to PyPI / Build wheels on ubuntu-latest (push) Has been cancelled
Publish to PyPI / Build wheels on windows-latest (push) Has been cancelled
Publish to PyPI / Publish to PyPI (push) Has been cancelled
2025-11-23 13:07:02 -07:00
Bill
26d1eb631e
version update to publish to Pypi 2
Publish to PyPI / Build wheels on macos-latest (push) Has been cancelled
Publish to PyPI / Build wheels on ubuntu-latest (push) Has been cancelled
Publish to PyPI / Build wheels on windows-latest (push) Has been cancelled
Publish to PyPI / Publish to PyPI (push) Has been cancelled
2025-11-23 12:53:54 -07:00
Bill
d6bd2eee00
version update to publish to Pypi
Publish to PyPI / Build wheels on macos-latest (push) Has been cancelled
Publish to PyPI / Build wheels on ubuntu-latest (push) Has been cancelled
Publish to PyPI / Build wheels on windows-latest (push) Has been cancelled
Publish to PyPI / Publish to PyPI (push) Has been cancelled
2025-11-23 12:45:31 -07:00
Bill
06a6dcdd31
fixing for pypi upload
2025-11-22 23:37:57 -07:00
Bill
c338fcae65
make tracy optional, add readme.md, continue fixing thrashing for sequential reads for workers
2025-11-22 22:11:08 -07:00
Bill
95f88ee6e4
documents for new features and fixes added
2025-11-21 17:51:00 -07:00
