@FIR-546: Update 6.6.51 LTS #20
Closed
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Signed-off-by: Shaunak Saha [email protected]
Update to 6.6.51 LTS and include the tsavorite specific patches: @FIR-507: Preliminary changes to test upto 3GB memory. Test results are as follows
root@agilex7_dk_si_agf014ea:/usr/bin/tsi/v0.1.1.tsv22_02_03_2025/bin# ./run_platform_test.sh Check if tnApcMgr is running; if it is not, uncomment below line and execute the run_platform_test.sh script. Running on v0.1.1.tsv22_02_03_2025
[LlamaForCausalLM_Random v.1] Allocated DRAM arrays (host VAs): input0 = 0xffffa3a9d080 input1 = 0xffffa2e9d080 output0 = 0xffffa369d080 [LlamaForCausalLM_Random v.1] Model executed successfully. Validating result... [LlamaForCausalLM_Random v.1] PASS [relative err=0.000001] root@agilex7_dk_si_agf014ea:/usr/bin/tsi/v0.1.1.tsv22_02_03_2025/bin# cd aot-tests/ root@agilex7_dk_si_agf014ea:/usr/bin/tsi/v0.1.1.tsv22_02_03_2025/bin/aot-tests# root@agilex7_dk_si_agf014ea:/usr/bin/tsi/v0.1.1.tsv22_02_03_2025/bin/aot-tests# ./models/llama_sp/llama_sp.sh ./models/llama_sp/llama_sp.exe: error while loading shared libraries: libTsavRTFPGA.so.0.3.4: cannot open shared object file: No such file or directory root@agilex7_dk_si_agf014ea:/usr/bin/tsi/v0.1.1.tsv22_02_03_2025/bin/aot-tests# export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/bin/tsi/v0.1.1.tsv22_02_03_2025/bin/aot-tests/lib/ root@agilex7_dk_si_agf014ea:/usr/bin/tsi/v0.1.1.tsv22_02_03_2025/bin/aot-tests# ./models/llama_sp/llama_sp.sh Environment variable TOKENIZER_MODEL_PATH is not set. Please set it to the path of the tokenizer model. root@agilex7_dk_si_agf014ea:/usr/bin/tsi/v0.1.1.tsv22_02_03_2025/bin/aot-tests# ls /tsi/
animesh anoop_dec15 atrivedi cdogra dinesh lost+found ross sponnambalam tsi-sw
anoop aot-tests bnorris demo dmohapatra meera runtime test vgarg
root@agilex7_dk_si_agf014ea:/usr/bin/tsi/v0.1.1.tsv22_02_03_2025/bin/aot-tests# ls /tsi/atrivedi/
_deps aot-all-tests.tz lib models rt_lib.txt rtlib_0.3.1.tz tokenizer.model tvu ullama ullama_bf16 usr_lib.txt
root@agilex7_dk_si_agf014ea:/usr/bin/tsi/v0.1.1.tsv22_02_03_2025/bin/aot-tests# export TOKENIZER_MODEL_PATH=/tsi/atrivedi/tokenizer.model
root@agilex7_dk_si_agf014ea:/usr/bin/tsi/v0.1.1.tsv22_02_03_2025/bin/aot-tests# ./models/llama_sp/llama_sp.sh
Generating text...
Generated token 4/26: " a " (ID: 260 ) - Time: 3.22 s
Generated token 5/26: " sound " (ID: 2144 ) - Time: 3.18 s
Generated token 6/26: " ' " (ID: 31876 ) - Time: 3.19 s
Generated token 7/26: " s " (ID: 31829 ) - Time: 3.20 s
Generated token 8/26: " coat " (ID: 13085 ) - Time: 3.15 s
Generated token 9/26: " . " (ID: 31843 ) - Time: 3.15 s
Generated token 10/26: " He " (ID: 636 ) - Time: 3.15 s
Generated token 11/26: " says " (ID: 1329 ) - Time: 3.15 s
Generated token 12/26: " , " (ID: 31844 ) - Time: 3.18 s
Generated token 13/26: " " " (ID: 495 ) - Time: 3.18 s
Generated token 14/26: " I " (ID: 31850 ) - Time: 3.18 s
Generated token 15/26: " will " (ID: 482 ) - Time: 3.15 s
Generated token 16/26: " try " (ID: 1489 ) - Time: 3.15 s
Generated token 17/26: " !" " (ID: 6573 ) - Time: 3.18 s
Generated token 18/26: "
" (ID: 13 ) - Time: 3.15 s
Generated token 19/26: " The " (ID: 1046 ) - Time: 3.19 s
Generated token 20/26: " dog " (ID: 3924 ) - Time: 3.19 s
Generated token 21/26: " looks " (ID: 3529 ) - Time: 3.15 s
Generated token 22/26: " up " (ID: 550 ) - Time: 3.15 s
Generated token 23/26: " and " (ID: 291 ) - Time: 3.15 s
Generated token 24/26: " saw " (ID: 2815 ) - Time: 3.16 s
Generated token 25/26: " the " (ID: 266 ) - Time: 3.15 s
Generated text:
My cat is a sound's coat. He says, "I will try!"
The dog looks up and saw the
Description: <Description the change of this Pull Request. Include HSD#, related Pull Request>
Impact Analysis:
Regression Test result: <Regtest result link .>