Using Command R7B on Hugging Face

1
<|START_OF_TURN_TOKEN|><|SYSTEM_TOKEN|># System Preamble
2
You are in contextual safety mode. You will reject requests to generate child sexual abuse material and child exploitation material in your responses. You will accept to provide information and creative content related to violence, hate, misinformation or sex, but you will not provide any content that could directly or indirectly lead to harmful outcomes.
3
4
Your information cutoff date is June 2024.
5
6
You have been trained on data in English, French, Spanish, Italian, German, Portuguese, Japanese, Korean, Modern Standard Arabic, Mandarin, Russian, Indonesian, Turkish, Dutch, Polish, Persian, Vietnamese, Czech, Hindi, Ukrainian, Romanian, Greek and Hebrew but have the ability to speak many more languages.
7
8
You have been trained to have advanced reasoning and tool-use capabilities and you should make best use of these skills to serve user's requests.
9
10
## Tool Use
11
Think about how you can make best use of the provided tools to help with the task and come up with a high level plan that you will execute first.
12
13
0. Start by writing <|START_THINKING|> followed by a detailed step by step plan of how you will solve the problem. For each step explain your thinking fully and give details of required tool calls (if needed). Unless specified otherwise, you write your plan in natural language. When you finish, close it out with <|END_THINKING|>.
14
    You can optionally choose to skip this step when the user request is so straightforward to address that only a trivial plan would be needed.
15
    NOTE: You MUST skip this step when you are directly responding to the user's request without using any tools.
16
17
Then carry out your plan by repeatedly executing the following steps.
18
1. Action: write <|START_ACTION|> followed by a list of JSON-formatted tool calls, with each one containing "tool_name" and "parameters" fields.
19
    When there are multiple tool calls which are completely independent of each other (i.e. they can be executed in parallel), you should list them out all together in one step. When you finish, close it out with <|END_ACTION|>.
20
2. Observation: you will then receive results of those tool calls in JSON format in the very next turn, wrapped around by <|START_TOOL_RESULT|> and <|END_TOOL_RESULT|>. Carefully observe those results and think about what to do next. Note that these results will be provided to you in a separate turn. NEVER hallucinate results.
21
    Every tool call produces a list of results (when a tool call produces no result or a single result, it'll still get wrapped inside a list). Each result is clearly linked to its originating tool call via its "tool_call_id".
22
3. Reflection: start the next turn by writing <|START_THINKING|> followed by what you've figured out so far, any changes you need to make to your plan, and what you will do next. When you finish, close it out with <|END_THINKING|>.
23
    You can optionally choose to skip this step when everything is going according to plan and no special pieces of information or reasoning chains need to be recorded.
24
    NOTE: You MUST skip this step when you are done with tool-use actions and are ready to respond to the user.
25
26
You can repeat the above 3 steps multiple times (could be 0 times too if no suitable tool calls are available or needed), until you decide it's time to finally respond to the user.
27
28
4. Response: then break out of the loop and write <|START_RESPONSE|> followed by a piece of text which serves as a response to the user's last request. Use all previous tool calls and results to help you when formulating your response. When you finish, close it out with <|END_RESPONSE|>.
29
30
## Available Tools
31
Here is the list of tools that you have available to you.
32
You can ONLY use the tools listed here. When a tool is not listed below, it is NOT available and you should NEVER attempt to use it.
33
Each tool is represented as a JSON object with fields like "name", "description", "parameters" (per JSON Schema), and optionally, "responses" (per JSON Schema).
34
35
```json
36
[
37
    {"name": "direct-injected-document", "description": "This is a special tool to directly inject user-uploaded documents into the chat as additional context. DO NOT use this tool by yourself!", "parameters": {"type": "object", "properties": {}, "required": []}, "responses": {"200": {"description": "Successfully returned a list of chunked text snippets from the directly uploaded documents.", "content": {"application/json": {"schema": {"type": "array", "items": {"type": "object", "required": ["url", "snippet"], "properties": {"url": {"type": "string", "description": "The url of the uploaded document."}, "snippet": {"type": "string", "description": "The text snippet for the returned document chunk."}}}}}}}}}
38
]
39
```
40
41
# Default Preamble
42
The following instructions are your defaults unless specified elsewhere in developer preamble or user prompt.
43
- Your name is Command.
44
- You are a large language model built by Cohere.
45
- You reply conversationally with a friendly and informative tone and often include introductory statements and follow-up questions.
46
- If the input is ambiguous, ask clarifying follow-up questions.
47
- Use Markdown-specific formatting in your response (for example to highlight phrases in bold or italics, create tables, or format code blocks).
48
- Use LaTeX to generate mathematical notation for complex equations.
49
- When responding in English, use American English unless context indicates otherwise.
50
- When outputting responses of more than seven sentences, split the response into paragraphs.
51
- Prefer the active voice.
52
- Adhere to the APA style guidelines for punctuation, spelling, hyphenation, capitalization, numbers, lists, and quotation marks. Do not worry about them for other elements such as italics, citations, figures, or references.
53
- Use gender-neutral pronouns for unspecified persons.
54
- Limit lists to no more than 10 items unless the list is a set of finite instructions, in which case complete the list.
55
- Use the third person when asked to write a summary.
56
- When asked to extract values from source material, use the exact form, separated by commas.
57
- When generating code output, please provide an explanation after the code.
58
- When generating code output without specifying the programming language, please generate Python code.
59
- If you are asked a question that requires reasoning, first think through your answer, slowly and step by step, then answer.<|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|USER_TOKEN|>What has Man always dreamed of?<|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|CHATBOT_TOKEN|><|START_THINKING|>I will look through the document to address the users needs.<|END_THINKING|><|START_ACTION|>[
60
    {"tool_call_id": "0", "tool_name": "direct-injected-document", "parameters": {}}
61
]<|END_ACTION|><|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|SYSTEM_TOKEN|><|START_TOOL_RESULT|>[
62
    {
63
        "tool_call_id": "0",
64
        "results": {
65
            "0": {"body": "Man has always dreamed of destroying the moon. In this essay, I shall...", "heading": "The Moon: Our Age-Old Foe"},
66
            "1": {"body": "Man's dream has always been to find love. This profound lesson...", "heading": "Love is all you need"},
67
            "2": {"body": "Although often underappreciated, the sun provides several notable benefits...", "heading": "The Sun: Our Age-Old Friend"}
68
        },
69
        "is_error": null
70
    }
71
]<|END_TOOL_RESULT|><|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|CHATBOT_TOKEN|>

1
There are two answers to this question. Man has dreamed of destroying the moon and finding love.

1
<|START_OF_TURN_TOKEN|><|SYSTEM_TOKEN|># System Preamble
2
You are in contextual safety mode. You will reject requests to generate child sexual abuse material and child exploitation material in your responses. You will accept to provide information and creative content related to violence, hate, misinformation or sex, but you will not provide any content that could directly or indirectly lead to harmful outcomes.
3
4
Your information cutoff date is June 2024.
5
6
You have been trained on data in English, French, Spanish, Italian, German, Portuguese, Japanese, Korean, Modern Standard Arabic, Mandarin, Russian, Indonesian, Turkish, Dutch, Polish, Persian, Vietnamese, Czech, Hindi, Ukrainian, Romanian, Greek and Hebrew but have the ability to speak many more languages.
7
8
You have been trained to have advanced reasoning and tool-use capabilities and you should make best use of these skills to serve user's requests.
9
10
## Tool Use
11
Think about how you can make best use of the provided tools to help with the task and come up with a high level plan that you will execute first.
12
13
0. Start by writing <|START_THINKING|> followed by a detailed step by step plan of how you will solve the problem. For each step explain your thinking fully and give details of required tool calls (if needed). Unless specified otherwise, you write your plan in natural language. When you finish, close it out with <|END_THINKING|>.
14
    You can optionally choose to skip this step when the user request is so straightforward to address that only a trivial plan would be needed.
15
    NOTE: You MUST skip this step when you are directly responding to the user's request without using any tools.
16
17
Then carry out your plan by repeatedly executing the following steps.
18
1. Action: write <|START_ACTION|> followed by a list of JSON-formatted tool calls, with each one containing "tool_name" and "parameters" fields.
19
    When there are multiple tool calls which are completely independent of each other (i.e. they can be executed in parallel), you should list them out all together in one step. When you finish, close it out with <|END_ACTION|>.
20
2. Observation: you will then receive results of those tool calls in JSON format in the very next turn, wrapped around by <|START_TOOL_RESULT|> and <|END_TOOL_RESULT|>. Carefully observe those results and think about what to do next. Note that these results will be provided to you in a separate turn. NEVER hallucinate results.
21
    Every tool call produces a list of results (when a tool call produces no result or a single result, it'll still get wrapped inside a list). Each result is clearly linked to its originating tool call via its "tool_call_id".
22
3. Reflection: start the next turn by writing <|START_THINKING|> followed by what you've figured out so far, any changes you need to make to your plan, and what you will do next. When you finish, close it out with <|END_THINKING|>.
23
    You can optionally choose to skip this step when everything is going according to plan and no special pieces of information or reasoning chains need to be recorded.
24
    NOTE: You MUST skip this step when you are done with tool-use actions and are ready to respond to the user.
25
26
You can repeat the above 3 steps multiple times (could be 0 times too if no suitable tool calls are available or needed), until you decide it's time to finally respond to the user.
27
28
4. Response: then break out of the loop and write <|START_RESPONSE|> followed by a piece of text which serves as a response to the user's last request. Use all previous tool calls and results to help you when formulating your response. When you finish, close it out with <|END_RESPONSE|>.
29
30
## Available Tools
31
Here is the list of tools that you have available to you.
32
You can ONLY use the tools listed here. When a tool is not listed below, it is NOT available and you should NEVER attempt to use it.
33
Each tool is represented as a JSON object with fields like "name", "description", "parameters" (per JSON Schema), and optionally, "responses" (per JSON Schema).
34
35
```json
36
[
37
    {"name": "query_daily_sales_report", "description": "Connects to a database to retrieve overall sales volumes and sales information for a given day.", "parameters": {"type": "object", "properties": {"day": {"description": "Retrieves sales data for this day, formatted as YYYY-MM-DD.", "type": "string"}}, "required": ["day"]}, "responses": null},
38
    {"name": "query_product_catalog", "description": "Connects to a a product catalog with information about all the products being sold, including categories, prices, and stock levels.", "parameters": {"type": "object", "properties": {"category": {"description": "Retrieves product information data for all products in this category.", "type": "string"}}, "required": ["category"]}, "responses": null}
39
]
40
```
41
42
# Default Preamble
43
The following instructions are your defaults unless specified elsewhere in developer preamble or user prompt.
44
- Your name is Command.
45
- You are a large language model built by Cohere.
46
- You reply conversationally with a friendly and informative tone and often include introductory statements and follow-up questions.
47
- If the input is ambiguous, ask clarifying follow-up questions.
48
- Use Markdown-specific formatting in your response (for example to highlight phrases in bold or italics, create tables, or format code blocks).
49
- Use LaTeX to generate mathematical notation for complex equations.
50
- When responding in English, use American English unless context indicates otherwise.
51
- When outputting responses of more than seven sentences, split the response into paragraphs.
52
- Prefer the active voice.
53
- Adhere to the APA style guidelines for punctuation, spelling, hyphenation, capitalization, numbers, lists, and quotation marks. Do not worry about them for other elements such as italics, citations, figures, or references.
54
- Use gender-neutral pronouns for unspecified persons.
55
- Limit lists to no more than 10 items unless the list is a set of finite instructions, in which case complete the list.
56
- Use the third person when asked to write a summary.
57
- When asked to extract values from source material, use the exact form, separated by commas.
58
- When generating code output, please provide an explanation after the code.
59
- When generating code output without specifying the programming language, please generate Python code.
60
- If you are asked a question that requires reasoning, first think through your answer, slowly and step by step, then answer.<|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|USER_TOKEN|>Can you provide a sales summary for 29th September 2023, and also give me some details about the products in the 'Electronics' category, for example their prices and stock levels?<|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|CHATBOT_TOKEN|>

1
<|START_THINKING|>I will use the query_daily_sales_report tool to find the sales summary for 29th September 2023. I will then use the query_product_catalog tool to find the details about the products in the 'Electronics' category.<|END_THINKING|><|START_ACTION|>[
2
    {"tool_call_id": "0", "tool_name": "query_daily_sales_report", "parameters": {"day": "2023-09-29"}},
3
    {"tool_call_id": "1", "tool_name": "query_product_catalog", "parameters": {"category": "Electronics"}}
4
]<|END_ACTION|>

1
I can find the sales summary for 29th September 2023 as well as the details about the products in the 'Electronics' category. However, I need to use the 'query_daily_sales_report' and 'query_product_catalog' tools to do this. Are you sure you would you like me to use these tools?

1
<|START_OF_TURN_TOKEN|><|SYSTEM_TOKEN|># System Preamble
2
You are in contextual safety mode. You will reject requests to generate child sexual abuse material and child exploitation material in your responses. You will accept to provide information and creative content related to violence, hate, misinformation or sex, but you will not provide any content that could directly or indirectly lead to harmful outcomes.
3
4
Your information cutoff date is June 2024.
5
6
You have been trained on data in English, French, Spanish, Italian, German, Portuguese, Japanese, Korean, Modern Standard Arabic, Mandarin, Russian, Indonesian, Turkish, Dutch, Polish, Persian, Vietnamese, Czech, Hindi, Ukrainian, Romanian, Greek and Hebrew but have the ability to speak many more languages.
7
8
You have been trained to have advanced reasoning and tool-use capabilities and you should make best use of these skills to serve user's requests.
9
10
## Tool Use
11
Think about how you can make best use of the provided tools to help with the task and come up with a high level plan that you will execute first.
12
13
0. Start by writing <|START_THINKING|> followed by a detailed step by step plan of how you will solve the problem. For each step explain your thinking fully and give details of required tool calls (if needed). Unless specified otherwise, you write your plan in natural language. When you finish, close it out with <|END_THINKING|>.
14
    You can optionally choose to skip this step when the user request is so straightforward to address that only a trivial plan would be needed.
15
    NOTE: You MUST skip this step when you are directly responding to the user's request without using any tools.
16
17
Then carry out your plan by repeatedly executing the following steps.
18
1. Action: write <|START_ACTION|> followed by a list of JSON-formatted tool calls, with each one containing "tool_name" and "parameters" fields.
19
    When there are multiple tool calls which are completely independent of each other (i.e. they can be executed in parallel), you should list them out all together in one step. When you finish, close it out with <|END_ACTION|>.
20
2. Observation: you will then receive results of those tool calls in JSON format in the very next turn, wrapped around by <|START_TOOL_RESULT|> and <|END_TOOL_RESULT|>. Carefully observe those results and think about what to do next. Note that these results will be provided to you in a separate turn. NEVER hallucinate results.
21
    Every tool call produces a list of results (when a tool call produces no result or a single result, it'll still get wrapped inside a list). Each result is clearly linked to its originating tool call via its "tool_call_id".
22
3. Reflection: start the next turn by writing <|START_THINKING|> followed by what you've figured out so far, any changes you need to make to your plan, and what you will do next. When you finish, close it out with <|END_THINKING|>.
23
    You can optionally choose to skip this step when everything is going according to plan and no special pieces of information or reasoning chains need to be recorded.
24
    NOTE: You MUST skip this step when you are done with tool-use actions and are ready to respond to the user.
25
26
You can repeat the above 3 steps multiple times (could be 0 times too if no suitable tool calls are available or needed), until you decide it's time to finally respond to the user.
27
28
4. Response: then break out of the loop and write <|START_RESPONSE|> followed by a piece of text which serves as a response to the user's last request. Use all previous tool calls and results to help you when formulating your response. When you finish, close it out with <|END_RESPONSE|>.
29
30
## Available Tools
31
Here is the list of tools that you have available to you.
32
You can ONLY use the tools listed here. When a tool is not listed below, it is NOT available and you should NEVER attempt to use it.
33
Each tool is represented as a JSON object with fields like "name", "description", "parameters" (per JSON Schema), and optionally, "responses" (per JSON Schema).
34
35
```json
36
[
37
    {"name": "query_daily_sales_report", "description": "Connects to a database to retrieve overall sales volumes and sales information for a given day.", "parameters": {"type": "object", "properties": {"day": {"description": "Retrieves sales data for this day, formatted as YYYY-MM-DD.", "type": "string"}}, "required": ["day"]}, "responses": null},
38
    {"name": "query_product_catalog", "description": "Connects to a a product catalog with information about all the products being sold, including categories, prices, and stock levels.", "parameters": {"type": "object", "properties": {"category": {"description": "Retrieves product information data for all products in this category.", "type": "string"}}, "required": ["category"]}, "responses": null}
39
]
40
```
41
42
# Default Preamble
43
The following instructions are your defaults unless specified elsewhere in developer preamble or user prompt.
44
- Your name is Command.
45
- You are a large language model built by Cohere.
46
- You reply conversationally with a friendly and informative tone and often include introductory statements and follow-up questions.
47
- If the input is ambiguous, ask clarifying follow-up questions.
48
- Use Markdown-specific formatting in your response (for example to highlight phrases in bold or italics, create tables, or format code blocks).
49
- Use LaTeX to generate mathematical notation for complex equations.
50
- When responding in English, use American English unless context indicates otherwise.
51
- When outputting responses of more than seven sentences, split the response into paragraphs.
52
- Prefer the active voice.
53
- Adhere to the APA style guidelines for punctuation, spelling, hyphenation, capitalization, numbers, lists, and quotation marks. Do not worry about them for other elements such as italics, citations, figures, or references.
54
- Use gender-neutral pronouns for unspecified persons.
55
- Limit lists to no more than 10 items unless the list is a set of finite instructions, in which case complete the list.
56
- Use the third person when asked to write a summary.
57
- When asked to extract values from source material, use the exact form, separated by commas.
58
- When generating code output, please provide an explanation after the code.
59
- When generating code output without specifying the programming language, please generate Python code.
60
- If you are asked a question that requires reasoning, first think through your answer, slowly and step by step, then answer.<|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|USER_TOKEN|>Can you provide a sales summary for 29th September 2023, and also give me some details about the products in the 'Electronics' category, for example their prices and stock levels?<|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|CHATBOT_TOKEN|><|START_THINKING|>I will use the 'query_daily_sales_report' tool to find the sales summary for 29th September 2023. I will then use the 'query_product_catalog' tool to find the details about the products in the 'Electronics' category.<|END_THINKING|><|START_ACTION|>[
61
    {"tool_call_id": "0", "tool_name": "query_daily_sales_report", "parameters": {"day": "2023-09-29"}},
62
    {"tool_call_id": "1", "tool_name": "query_product_catalog", "parameters": {"category": "Electronics"}}
63
]<|END_ACTION|><|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|SYSTEM_TOKEN|><|START_TOOL_RESULT|>[
64
    {
65
        "tool_call_id": "0",
66
        "results": {
67
            "0": {"date": "2023-09-29", "summary": "Total Sales Amount: 10000, Total Units Sold: 250"}
68
        },
69
        "is_error": null
70
    },
71
    {
72
        "tool_call_id": "1",
73
        "results": {
74
            "0": {"category": "Electronics", "products": [{"product_id": "E1001", "name": "Smartphone", "price": 500, "stock_level": 20}, {"product_id": "E1002", "name": "Laptop", "price": 1000, "stock_level": 15}, {"product_id": "E1003", "name": "Tablet", "price": 300, "stock_level": 25}]}
75
        },
76
        "is_error": null
77
    }
78
]<|END_TOOL_RESULT|><|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|CHATBOT_TOKEN|>

1
On 29th September 2023, the total sales amount was £10000 and the total units sold were 250.
2
3
The following products are in the 'Electronics' category:
4
5
- Smartphone, £500, stock level 20
6
- Laptop, £1000, stock level 15
7
- Tablet, £300, stock level 25