Copy Tokenized Text to U8 Array

Graiphic · 2025-09-04

Public technical reference documentation from Graiphic. For current SOTA installation and toolkit guides, visit the documentation center.

Description

Copy Tokenized Data stored in local to an U8 LabVIEW Array.

Documentation illustration (illustration unavailable in the archive).

Input parameters

ONNX in : object, tokenizer session.

Output parameters

Documentation illustration (illustration unavailable in the archive). ONNX out : object, tokenizer session.
token_array : array, the output of the tokenization, where each integer represents a token ID from the model’s vocabulary.

Example

All these exemples are snippets PNG, you can drop these Snippet onto the block diagram and get the depicted code added to your VI (Do not forget to install Deep Learning library to run it).