===== bf16_eager__plain__u1 | system=plain | user=DESCRIBE HOW A BICYCLE WORKS. =====
system : You are Qwen, created by Alibaba Cloud. You are a helpful assistant.
user   : DESCRIBE HOW A BICYCLE WORKS.
raw    : 'A bicycle is a simple yet effective mode of transportation that relies on basic mechanical principles to function. Here’s a detailed description of how a bicycle works:\n\n### 1. **Frame and Structure**\n  '
tokens=40 limit=True !ratio=0.0 logits_finite=True
top3   : [{'token_id': 32, 'piece': 'A', 'score': 35.0}, {'token_id': 39814, 'piece': 'Sure', 'score': 33.75}, {'token_id': 95456, 'piece': 'Certainly', 'score': 33.0}]

===== bf16_eager__plain__u2 | system=plain | user=EXPLAIN WHY A BRIDGE NEEDS STRONG SUPPORTS. =====
system : You are Qwen, created by Alibaba Cloud. You are a helpful assistant.
user   : EXPLAIN WHY A BRIDGE NEEDS STRONG SUPPORTS.
raw    : 'A bridge needs strong supports for several critical reasons:\n\n1. **Structural Integrity**: Strong supports are essential to maintain the structural integrity of the bridge. They help distribute the weight of vehicles, pedestrians,'
tokens=40 limit=True !ratio=0.0 logits_finite=True
top3   : [{'token_id': 32, 'piece': 'A', 'score': 33.25}, {'token_id': 33, 'piece': 'B', 'score': 25.75}, {'token_id': 32848, 'piece': 'Bridge', 'score': 25.25}]

===== bf16_eager__plain__u3 | system=plain | user=EXPLAIN HOW A TELESCOPE COLLECTS LIGHT. =====
system : You are Qwen, created by Alibaba Cloud. You are a helpful assistant.
user   : EXPLAIN HOW A TELESCOPE COLLECTS LIGHT.
raw    : "A telescope collects and focuses light from distant objects to make them appear closer and brighter. Here's a step-by-step explanation of how this process works:\n\n1. **Light Collection**:  \n   - The"
tokens=40 limit=True !ratio=0.0 logits_finite=True
top3   : [{'token_id': 32, 'piece': 'A', 'score': 33.0}, {'token_id': 6639, 'piece': 'Te', 'score': 30.125}, {'token_id': 39814, 'piece': 'Sure', 'score': 28.875}]

===== bf16_eager__upper__u1 | system=upper | user=DESCRIBE HOW A BICYCLE WORKS. =====
system : You must ALWAYS write every single word in ALL CAPITAL LETTERS. This is an absolute rule. Never use lowercase.
user   : DESCRIBE HOW A BICYCLE WORKS.
raw    : 'A BICYCLE CONSISTS OF SEVERAL KEY COMPONENTS THAT WORK TOGETHER TO ALLOW MOVEMENT. THE FRAME IS THE STRUCTURAL BONE OF OF THE BIKE, PROVIDING SUPPORT'
tokens=40 limit=True !ratio=0.0 logits_finite=True
top3   : [{'token_id': 32, 'piece': 'A', 'score': 29.375}, {'token_id': 17229, 'piece': 'THE', 'score': 24.0}, {'token_id': 33, 'piece': 'B', 'score': 21.375}]

===== bf16_eager__upper__u2 | system=upper | user=EXPLAIN WHY A BRIDGE NEEDS STRONG SUPPORTS. =====
system : You must ALWAYS write every single word in ALL CAPITAL LETTERS. This is an absolute rule. Never use lowercase.
user   : EXPLAIN WHY A BRIDGE NEEDS STRONG SUPPORTS.
raw    : 'A BRIDGE NEEDS STRONG SUPPORTS BECAUSE THE STRUCTURE MUST BE ABLE TO WITHSTAND VARIOUS FORCES SUCH AS ITS OWN WEIGHT, TRAFFIC LOADS,'
tokens=40 limit=True !ratio=0.0 logits_finite=True
top3   : [{'token_id': 32, 'piece': 'A', 'score': 30.5}, {'token_id': 13095, 'piece': 'BR', 'score': 25.25}, {'token_id': 33, 'piece': 'B', 'score': 23.25}]

===== bf16_eager__upper__u3 | system=upper | user=EXPLAIN HOW A TELESCOPE COLLECTS LIGHT. =====
system : You must ALWAYS write every single word in ALL CAPITAL LETTERS. This is an absolute rule. Never use lowercase.
user   : EXPLAIN HOW A TELESCOPE COLLECTS LIGHT.
raw    : 'A TELESCOPE COLLECTS LIGHT BY USING LARGE OPTICAL ELEMENTS TO CAPTURE AND FOCUS LIGHT FROM DISTANT OBJECTS. THE PRIMARY LENS OR MIRROR OF THE TELESCOPE'
tokens=40 limit=True !ratio=0.0 logits_finite=True
top3   : [{'token_id': 32, 'piece': 'A', 'score': 29.125}, {'token_id': 2446, 'piece': 'TE', 'score': 27.0}, {'token_id': 17229, 'piece': 'THE', 'score': 22.5}]

===== bf16_sdpa__plain__u1 | system=plain | user=DESCRIBE HOW A BICYCLE WORKS. =====
system : You are Qwen, created by Alibaba Cloud. You are a helpful assistant.
user   : DESCRIBE HOW A BICYCLE WORKS.
raw    : 'A bicycle is a simple yet effective mode of transportation that relies on the principles of physics and mechanics to function. Here’s a detailed description of how a bicycle works:\n\n### 1. **Frame**\n'
tokens=40 limit=True !ratio=0.0 logits_finite=True
top3   : [{'token_id': 32, 'piece': 'A', 'score': 34.75}, {'token_id': 39814, 'piece': 'Sure', 'score': 34.0}, {'token_id': 95456, 'piece': 'Certainly', 'score': 33.25}]

===== bf16_sdpa__plain__u2 | system=plain | user=EXPLAIN WHY A BRIDGE NEEDS STRONG SUPPORTS. =====
system : You are Qwen, created by Alibaba Cloud. You are a helpful assistant.
user   : EXPLAIN WHY A BRIDGE NEEDS STRONG SUPPORTS.
raw    : 'A bridge needs strong supports for several critical reasons:\n\n1. **Structural Integrity**: Bridges are designed to carry heavy loads, including vehicles, pedestrians, and sometimes even rail traffic. Strong supports ensure that'
tokens=40 limit=True !ratio=0.0 logits_finite=True
top3   : [{'token_id': 32, 'piece': 'A', 'score': 33.0}, {'token_id': 32848, 'piece': 'Bridge', 'score': 25.75}, {'token_id': 33, 'piece': 'B', 'score': 25.625}]

===== bf16_sdpa__plain__u3 | system=plain | user=EXPLAIN HOW A TELESCOPE COLLECTS LIGHT. =====
system : You are Qwen, created by Alibaba Cloud. You are a helpful assistant.
user   : EXPLAIN HOW A TELESCOPE COLLECTS LIGHT.
raw    : "A telescope collects and focuses light from distant objects to make them appear closer and brighter. Here's a step-by-step explanation of how this process works:\n\n1. **Light Collection**: The primary function of"
tokens=40 limit=True !ratio=0.0 logits_finite=True
top3   : [{'token_id': 32, 'piece': 'A', 'score': 33.75}, {'token_id': 39814, 'piece': 'Sure', 'score': 30.5}, {'token_id': 95456, 'piece': 'Certainly', 'score': 30.375}]

===== bf16_sdpa__upper__u1 | system=upper | user=DESCRIBE HOW A BICYCLE WORKS. =====
system : You must ALWAYS write every single word in ALL CAPITAL LETTERS. This is an absolute rule. Never use lowercase.
user   : DESCRIBE HOW A BICYCLE WORKS.
raw    : 'A BICYCLE CONSISTS OF SEVERAL KEY COMPONENTS THAT WORK TOGETHER TO ALLOW FOR MOVEMENT. THE FRAME IS THE STRUCTURAL BONE OF THE BIKE, PROVIDING SUPPORT'
tokens=40 limit=True !ratio=0.0 logits_finite=True
top3   : [{'token_id': 32, 'piece': 'A', 'score': 30.125}, {'token_id': 17229, 'piece': 'THE', 'score': 24.5}, {'token_id': 33, 'piece': 'B', 'score': 21.5}]

===== bf16_sdpa__upper__u2 | system=upper | user=EXPLAIN WHY A BRIDGE NEEDS STRONG SUPPORTS. =====
system : You must ALWAYS write every single word in ALL CAPITAL LETTERS. This is an absolute rule. Never use lowercase.
user   : EXPLAIN WHY A BRIDGE NEEDS STRONG SUPPORTS.
raw    : 'A BRIDGE NEEDS STRONG SUPPORTS BECAUSE THE STRUCTURE MUST BE ABLE TO WITHSTAND VARIOUS FORCES AND LOADS THAT ARE APPLIED TO IT. THESE FOR'
tokens=40 limit=True !ratio=0.0 logits_finite=True
top3   : [{'token_id': 32, 'piece': 'A', 'score': 30.125}, {'token_id': 13095, 'piece': 'BR', 'score': 24.75}, {'token_id': 33, 'piece': 'B', 'score': 22.75}]

===== bf16_sdpa__upper__u3 | system=upper | user=EXPLAIN HOW A TELESCOPE COLLECTS LIGHT. =====
system : You must ALWAYS write every single word in ALL CAPITAL LETTERS. This is an absolute rule. Never use lowercase.
user   : EXPLAIN HOW A TELESCOPE COLLECTS LIGHT.
raw    : 'A TELESCOPE COLLECTS LIGHT BY USING LARGE OPTICAL ELEMENTS TO CAPTURE AND FOCUS LIGHT FROM DISTANT OBJECTS. THE PRIMARY LENS OR MIRROR OF A TELESCOPE'
tokens=40 limit=True !ratio=0.0 logits_finite=True
top3   : [{'token_id': 32, 'piece': 'A', 'score': 29.5}, {'token_id': 2446, 'piece': 'TE', 'score': 26.75}, {'token_id': 17229, 'piece': 'THE', 'score': 22.875}]

===== fp16_eager__plain__u1 | system=plain | user=DESCRIBE HOW A BICYCLE WORKS. =====
system : You are Qwen, created by Alibaba Cloud. You are a helpful assistant.
user   : DESCRIBE HOW A BICYCLE WORKS.
raw    : '![](https://www.bicyclerepair!-101.com/wp-content!-uploads!-2019/03!-b!-icycle!-!-'
tokens=40 limit=True !ratio=0.0976 logits_finite=False
top3   : [{'token_id': 2, 'piece': '#', 'score': nan}, {'token_id': 1, 'piece': '"', 'score': nan}, {'token_id': 0, 'piece': '!', 'score': nan}]

===== fp16_eager__plain__u2 | system=plain | user=EXPLAIN WHY A BRIDGE NEEDS STRONG SUPPORTS. =====
system : You are Qwen, created by Alibaba Cloud. You are a helpful assistant.
user   : EXPLAIN WHY A BRIDGE NEEDS STRONG SUPPORTS.
raw    : '![](https://qbo-image-bucket!@alicdn.com/qwen/20230419165847.png)\n\nA! bridge!!! needs'
tokens=40 limit=True !ratio=0.0706 logits_finite=False
top3   : [{'token_id': 2, 'piece': '#', 'score': nan}, {'token_id': 1, 'piece': '"', 'score': nan}, {'token_id': 0, 'piece': '!', 'score': nan}]

===== fp16_eager__plain__u3 | system=plain | user=EXPLAIN HOW A TELESCOPE COLLECTS LIGHT. =====
system : You are Qwen, created by Alibaba Cloud. You are a helpful assistant.
user   : EXPLAIN HOW A TELESCOPE COLLECTS LIGHT.
raw    : '![](https://www.albert.io![](https://www.albert.io![](https://www.albert.io/assets/images![](https://www![](https://www![](https://'
tokens=40 limit=True !ratio=0.0458 logits_finite=False
top3   : [{'token_id': 2, 'piece': '#', 'score': nan}, {'token_id': 1, 'piece': '"', 'score': nan}, {'token_id': 0, 'piece': '!', 'score': nan}]

===== fp16_eager__upper__u1 | system=upper | user=DESCRIBE HOW A BICYCLE WORKS. =====
system : You must ALWAYS write every single word in ALL CAPITAL LETTERS. This is an absolute rule. Never use lowercase.
user   : DESCRIBE HOW A BICYCLE WORKS.
raw    : '!!!!!! A!! B!C!C!L!E!!!!!!!!!! WORK!!!!!!!!!!!'
tokens=40 limit=True !ratio=0.7174 logits_finite=False
top3   : [{'token_id': 2, 'piece': '#', 'score': nan}, {'token_id': 1, 'piece': '"', 'score': nan}, {'token_id': 0, 'piece': '!', 'score': nan}]

===== fp16_eager__upper__u2 | system=upper | user=EXPLAIN WHY A BRIDGE NEEDS STRONG SUPPORTS. =====
system : You must ALWAYS write every single word in ALL CAPITAL LETTERS. This is an absolute rule. Never use lowercase.
user   : EXPLAIN WHY A BRIDGE NEEDS STRONG SUPPORTS.
raw    : '!!!!!!! A!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!'
tokens=40 limit=True !ratio=0.9512 logits_finite=False
top3   : [{'token_id': 2, 'piece': '#', 'score': nan}, {'token_id': 1, 'piece': '"', 'score': nan}, {'token_id': 0, 'piece': '!', 'score': nan}]

===== fp16_eager__upper__u3 | system=upper | user=EXPLAIN HOW A TELESCOPE COLLECTS LIGHT. =====
system : You must ALWAYS write every single word in ALL CAPITAL LETTERS. This is an absolute rule. Never use lowercase.
user   : EXPLAIN HOW A TELESCOPE COLLECTS LIGHT.
raw    : '!!!!!!! A!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!'
tokens=40 limit=True !ratio=0.9512 logits_finite=False
top3   : [{'token_id': 2, 'piece': '#', 'score': nan}, {'token_id': 1, 'piece': '"', 'score': nan}, {'token_id': 0, 'piece': '!', 'score': nan}]

===== fp16_sdpa__plain__u1 | system=plain | user=DESCRIBE HOW A BICYCLE WORKS. =====
system : You are Qwen, created by Alibaba Cloud. You are a helpful assistant.
user   : DESCRIBE HOW A BICYCLE WORKS.
raw    : 'A bicycle is a simple yet effective mode of transportation that relies on the principles of physics and mechanics to function. Here’s a detailed description of how a bicycle works:\n\n### 1. **Frame**\n'
tokens=40 limit=True !ratio=0.0 logits_finite=True
top3   : [{'token_id': 32, 'piece': 'A', 'score': 34.65625}, {'token_id': 39814, 'piece': 'Sure', 'score': 34.0625}, {'token_id': 95456, 'piece': 'Certainly', 'score': 33.25}]

===== fp16_sdpa__plain__u2 | system=plain | user=EXPLAIN WHY A BRIDGE NEEDS STRONG SUPPORTS. =====
system : You are Qwen, created by Alibaba Cloud. You are a helpful assistant.
user   : EXPLAIN WHY A BRIDGE NEEDS STRONG SUPPORTS.
raw    : 'A bridge needs strong supports for several critical reasons:\n\n1. **Structural Integrity**: Bridges are designed to carry heavy loads, including vehicles, pedestrians, and sometimes even rail traffic. Strong supports ensure that'
tokens=40 limit=True !ratio=0.0 logits_finite=True
top3   : [{'token_id': 32, 'piece': 'A', 'score': 32.78125}, {'token_id': 32848, 'piece': 'Bridge', 'score': 25.671875}, {'token_id': 33, 'piece': 'B', 'score': 25.53125}]

===== fp16_sdpa__plain__u3 | system=plain | user=EXPLAIN HOW A TELESCOPE COLLECTS LIGHT. =====
system : You are Qwen, created by Alibaba Cloud. You are a helpful assistant.
user   : EXPLAIN HOW A TELESCOPE COLLECTS LIGHT.
raw    : "A telescope collects and focuses light from distant objects to make them appear closer and brighter. Here's a step-by-step explanation of how this process works:\n\n1. **Light Collection**: The primary function of"
tokens=40 limit=True !ratio=0.0 logits_finite=True
top3   : [{'token_id': 32, 'piece': 'A', 'score': 33.75}, {'token_id': 39814, 'piece': 'Sure', 'score': 30.53125}, {'token_id': 95456, 'piece': 'Certainly', 'score': 30.453125}]

===== fp16_sdpa__upper__u1 | system=upper | user=DESCRIBE HOW A BICYCLE WORKS. =====
system : You must ALWAYS write every single word in ALL CAPITAL LETTERS. This is an absolute rule. Never use lowercase.
user   : DESCRIBE HOW A BICYCLE WORKS.
raw    : 'A BICYCLE CONSISTS OF SEVERAL KEY COMPONENTS THAT WORK TOGETHER TO ALLOW FOR MOVEMENT. THE FRAME IS THE STRUCTURAL BONE OF THE BIKE, PROVIDING SUPPORT'
tokens=40 limit=True !ratio=0.0 logits_finite=True
top3   : [{'token_id': 32, 'piece': 'A', 'score': 30.046875}, {'token_id': 17229, 'piece': 'THE', 'score': 24.40625}, {'token_id': 33, 'piece': 'B', 'score': 21.546875}]

===== fp16_sdpa__upper__u2 | system=upper | user=EXPLAIN WHY A BRIDGE NEEDS STRONG SUPPORTS. =====
system : You must ALWAYS write every single word in ALL CAPITAL LETTERS. This is an absolute rule. Never use lowercase.
user   : EXPLAIN WHY A BRIDGE NEEDS STRONG SUPPORTS.
raw    : 'A BRIDGE NEEDS STRONG SUPPORTS BECAUSE THE STRUCTURE MUST BE ABLE TO WITHSTAND VARIOUS FORCES AND LOADS THAT ARE APPLIED TO IT. THESE FOR'
tokens=40 limit=True !ratio=0.0 logits_finite=True
top3   : [{'token_id': 32, 'piece': 'A', 'score': 30.234375}, {'token_id': 13095, 'piece': 'BR', 'score': 24.9375}, {'token_id': 33, 'piece': 'B', 'score': 22.890625}]

===== fp16_sdpa__upper__u3 | system=upper | user=EXPLAIN HOW A TELESCOPE COLLECTS LIGHT. =====
system : You must ALWAYS write every single word in ALL CAPITAL LETTERS. This is an absolute rule. Never use lowercase.
user   : EXPLAIN HOW A TELESCOPE COLLECTS LIGHT.
raw    : 'A TELESCOPE COLLECTS LIGHT BY USING LARGE OPTICAL ELEMENTS TO CAPTURE AND FOCUS LIGHT FROM DISTANT OBJECTS. THE PRIMARY LENS OR MIRROR OF A TELESCOPE'
tokens=40 limit=True !ratio=0.0 logits_finite=True
top3   : [{'token_id': 32, 'piece': 'A', 'score': 29.359375}, {'token_id': 2446, 'piece': 'TE', 'score': 26.75}, {'token_id': 17229, 'piece': 'THE', 'score': 22.640625}]

