Add abort support to the core ONNX provider chat function #7
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
The product copy of the ONNX provider takes a fourth argument
signaland stops calling the token callback once the signal is aborted. The core copy ofchatin core/providers/onnx.js has only three parameters, so a product that vendors the core loses the stop button for this provider. Why it matters: The core is the source the products vendor from; if it lacks the fix, the next sync removes abort support from the products.Proposal
Give
chata fourth parametersignal = nulland wrap the pipeline token callback soonTokenis not called aftersignal?.abortedis true.Acceptance criteria
chatfunction of core/providers/onnx.js declares a fourth parameter namedsignalwith defaultnull.signal,chatnever callsonToken, and with nosignalit still callsonTokenfor every token.Files
core/providers/onnx.jsT2T-Issue: 0xc061cbad52bed8ff95a90bbe778649684057e759d44b433dc318f7ba7fae0636
Number: 4
Kind: improvement
Origin: imported
Proposer: 0x08809b42d05ae9526f4aa4c9670ce168aac68919
Ledger: elffuss/ledger, event 481