Skip to content

@FIR-546: Update 6.6.51 LTS #20

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed

Conversation

reach2shaunak
Copy link

Signed-off-by: Shaunak Saha [email protected]

Update to 6.6.51 LTS and include the tsavorite specific patches: @FIR-507: Preliminary changes to test upto 3GB memory. Test results are as follows

root@agilex7_dk_si_agf014ea:/usr/bin/tsi/v0.1.1.tsv22_02_03_2025/bin# ./run_platform_test.sh Check if tnApcMgr is running; if it is not, uncomment below line and execute the run_platform_test.sh script. Running on v0.1.1.tsv22_02_03_2025

[LlamaForCausalLM_Random v.1] Allocated DRAM arrays (host VAs): input0 = 0xffffa3a9d080 input1 = 0xffffa2e9d080 output0 = 0xffffa369d080 [LlamaForCausalLM_Random v.1] Model executed successfully. Validating result... [LlamaForCausalLM_Random v.1] PASS [relative err=0.000001] root@agilex7_dk_si_agf014ea:/usr/bin/tsi/v0.1.1.tsv22_02_03_2025/bin# cd aot-tests/ root@agilex7_dk_si_agf014ea:/usr/bin/tsi/v0.1.1.tsv22_02_03_2025/bin/aot-tests# root@agilex7_dk_si_agf014ea:/usr/bin/tsi/v0.1.1.tsv22_02_03_2025/bin/aot-tests# ./models/llama_sp/llama_sp.sh ./models/llama_sp/llama_sp.exe: error while loading shared libraries: libTsavRTFPGA.so.0.3.4: cannot open shared object file: No such file or directory root@agilex7_dk_si_agf014ea:/usr/bin/tsi/v0.1.1.tsv22_02_03_2025/bin/aot-tests# export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/bin/tsi/v0.1.1.tsv22_02_03_2025/bin/aot-tests/lib/ root@agilex7_dk_si_agf014ea:/usr/bin/tsi/v0.1.1.tsv22_02_03_2025/bin/aot-tests# ./models/llama_sp/llama_sp.sh Environment variable TOKENIZER_MODEL_PATH is not set. Please set it to the path of the tokenizer model. root@agilex7_dk_si_agf014ea:/usr/bin/tsi/v0.1.1.tsv22_02_03_2025/bin/aot-tests# ls /tsi/
animesh anoop_dec15 atrivedi cdogra dinesh lost+found ross sponnambalam tsi-sw
anoop aot-tests bnorris demo dmohapatra meera runtime test vgarg
root@agilex7_dk_si_agf014ea:/usr/bin/tsi/v0.1.1.tsv22_02_03_2025/bin/aot-tests# ls /tsi/atrivedi/
_deps aot-all-tests.tz lib models rt_lib.txt rtlib_0.3.1.tz tokenizer.model tvu ullama ullama_bf16 usr_lib.txt
root@agilex7_dk_si_agf014ea:/usr/bin/tsi/v0.1.1.tsv22_02_03_2025/bin/aot-tests# export TOKENIZER_MODEL_PATH=/tsi/atrivedi/tokenizer.model
root@agilex7_dk_si_agf014ea:/usr/bin/tsi/v0.1.1.tsv22_02_03_2025/bin/aot-tests# ./models/llama_sp/llama_sp.sh

Generating text...
Generated token 4/26: " a " (ID: 260 ) - Time: 3.22 s
Generated token 5/26: " sound " (ID: 2144 ) - Time: 3.18 s
Generated token 6/26: " ' " (ID: 31876 ) - Time: 3.19 s
Generated token 7/26: " s " (ID: 31829 ) - Time: 3.20 s
Generated token 8/26: " coat " (ID: 13085 ) - Time: 3.15 s
Generated token 9/26: " . " (ID: 31843 ) - Time: 3.15 s
Generated token 10/26: " He " (ID: 636 ) - Time: 3.15 s
Generated token 11/26: " says " (ID: 1329 ) - Time: 3.15 s
Generated token 12/26: " , " (ID: 31844 ) - Time: 3.18 s
Generated token 13/26: " " " (ID: 495 ) - Time: 3.18 s
Generated token 14/26: " I " (ID: 31850 ) - Time: 3.18 s
Generated token 15/26: " will " (ID: 482 ) - Time: 3.15 s
Generated token 16/26: " try " (ID: 1489 ) - Time: 3.15 s
Generated token 17/26: " !" " (ID: 6573 ) - Time: 3.18 s
Generated token 18/26: "
" (ID: 13 ) - Time: 3.15 s
Generated token 19/26: " The " (ID: 1046 ) - Time: 3.19 s
Generated token 20/26: " dog " (ID: 3924 ) - Time: 3.19 s
Generated token 21/26: " looks " (ID: 3529 ) - Time: 3.15 s
Generated token 22/26: " up " (ID: 550 ) - Time: 3.15 s
Generated token 23/26: " and " (ID: 291 ) - Time: 3.15 s
Generated token 24/26: " saw " (ID: 2815 ) - Time: 3.16 s
Generated token 25/26: " the " (ID: 266 ) - Time: 3.15 s

Generated text:
My cat is a sound's coat. He says, "I will try!"
The dog looks up and saw the

Description: <Description the change of this Pull Request. Include HSD#, related Pull Request>

Impact Analysis:

What is the scope of the change?
<Is this something revolutionary and risky and challenging to manage, or will this be closer to business as usual or an evolutionary change?>

Purpose of the change?
<How clear is the outcome to be achieved? Has it been communicated, and are the objectives defined and achievable?>

Reach of the change?
<Will the change impact a single component or the impact to other components?>

Regression Test result: <Regtest result link .>

Signed-off-by: Shaunak Saha <[email protected]>

Update to 6.6.51 LTS and include the tsavorite specific patches:
@FIR-507: Preliminary changes to test upto 3GB memory.
Test results are as follows
---------------------------
root@agilex7_dk_si_agf014ea:/usr/bin/tsi/v0.1.1.tsv22_02_03_2025/bin# ./run_platform_test.sh
Check if tnApcMgr is running; if it is not, uncomment below line and execute the run_platform_test.sh script.
Running on v0.1.1.tsv22_02_03_2025

[LlamaForCausalLM_Random v.1] Allocated DRAM arrays (host VAs): input0 = 0xffffa3a9d080  input1 = 0xffffa2e9d080  output0 = 0xffffa369d080
[LlamaForCausalLM_Random v.1] Model executed successfully. Validating result...
[LlamaForCausalLM_Random v.1] PASS [relative err=0.000001]
root@agilex7_dk_si_agf014ea:/usr/bin/tsi/v0.1.1.tsv22_02_03_2025/bin# cd aot-tests/
root@agilex7_dk_si_agf014ea:/usr/bin/tsi/v0.1.1.tsv22_02_03_2025/bin/aot-tests#
root@agilex7_dk_si_agf014ea:/usr/bin/tsi/v0.1.1.tsv22_02_03_2025/bin/aot-tests# ./models/llama_sp/llama_sp.sh
./models/llama_sp/llama_sp.exe: error while loading shared libraries: libTsavRTFPGA.so.0.3.4: cannot open shared object file: No such file or directory
root@agilex7_dk_si_agf014ea:/usr/bin/tsi/v0.1.1.tsv22_02_03_2025/bin/aot-tests# export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/bin/tsi/v0.1.1.tsv22_02_03_2025/bin/aot-tests/lib/
root@agilex7_dk_si_agf014ea:/usr/bin/tsi/v0.1.1.tsv22_02_03_2025/bin/aot-tests# ./models/llama_sp/llama_sp.sh
Environment variable TOKENIZER_MODEL_PATH is not set. Please set it to the path of the tokenizer model.
root@agilex7_dk_si_agf014ea:/usr/bin/tsi/v0.1.1.tsv22_02_03_2025/bin/aot-tests# ls /tsi/
animesh       anoop_dec15   atrivedi      cdogra        dinesh        lost+found    ross          sponnambalam  tsi-sw
anoop         aot-tests     bnorris       demo          dmohapatra    meera         runtime       test          vgarg
root@agilex7_dk_si_agf014ea:/usr/bin/tsi/v0.1.1.tsv22_02_03_2025/bin/aot-tests# ls /tsi/atrivedi/
_deps             aot-all-tests.tz  lib               models            rt_lib.txt        rtlib_0.3.1.tz    tokenizer.model   tvu               ullama            ullama_bf16       usr_lib.txt
root@agilex7_dk_si_agf014ea:/usr/bin/tsi/v0.1.1.tsv22_02_03_2025/bin/aot-tests# export TOKENIZER_MODEL_PATH=/tsi/atrivedi/tokenizer.model
root@agilex7_dk_si_agf014ea:/usr/bin/tsi/v0.1.1.tsv22_02_03_2025/bin/aot-tests# ./models/llama_sp/llama_sp.sh

Generating text...
Generated token  4/26: " a              " (ID: 260   ) - Time: 3.22  s
Generated token  5/26: " sound          " (ID: 2144  ) - Time: 3.18  s
Generated token  6/26: " '              " (ID: 31876 ) - Time: 3.19  s
Generated token  7/26: " s              " (ID: 31829 ) - Time: 3.20  s
Generated token  8/26: " coat           " (ID: 13085 ) - Time: 3.15  s
Generated token  9/26: " .              " (ID: 31843 ) - Time: 3.15  s
Generated token 10/26: " He             " (ID: 636   ) - Time: 3.15  s
Generated token 11/26: " says           " (ID: 1329  ) - Time: 3.15  s
Generated token 12/26: " ,              " (ID: 31844 ) - Time: 3.18  s
Generated token 13/26: " "              " (ID: 495   ) - Time: 3.18  s
Generated token 14/26: " I              " (ID: 31850 ) - Time: 3.18  s
Generated token 15/26: " will           " (ID: 482   ) - Time: 3.15  s
Generated token 16/26: " try            " (ID: 1489  ) - Time: 3.15  s
Generated token 17/26: " !"             " (ID: 6573  ) - Time: 3.18  s
Generated token 18/26: "
              " (ID: 13    ) - Time: 3.15  s
Generated token 19/26: " The            " (ID: 1046  ) - Time: 3.19  s
Generated token 20/26: " dog            " (ID: 3924  ) - Time: 3.19  s
Generated token 21/26: " looks          " (ID: 3529  ) - Time: 3.15  s
Generated token 22/26: " up             " (ID: 550   ) - Time: 3.15  s
Generated token 23/26: " and            " (ID: 291   ) - Time: 3.15  s
Generated token 24/26: " saw            " (ID: 2815  ) - Time: 3.16  s
Generated token 25/26: " the            " (ID: 266   ) - Time: 3.15  s

Generated text:
My cat is a sound's coat. He says, "I will try!"
The dog looks up and saw the
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant