mirrors/mindcraft
1
0
Fork 0
mirror of https://github.com/kolbytn/mindcraft.git synced 2025-08-22 15:13:45 +02:00
Code Issues Projects Releases Packages Wiki Activity Actions

Merge branch 'main' into sideplacement

Browse source
This commit is contained in:
MaxRobinsonTheGreat 2024-06-22 15:19:10 -05:00
commit 6935035c7a
44 changed files with 2128 additions and 279 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
.gitignore vendored
View file

@ -1,6 +1,8 @@
.vscode/ .vscode/
node_modules/ node_modules/
package-lock.json package-lock.json
code_records/
scratch.js scratch.js
bots/**/action-code/** bots/**/action-code/**
bots/**/ bots/**/
keys.json

92
README.md
View file

@ -4,31 +4,35 @@ Crafting minds for Minecraft with Language Models and Mineflayer!
#### ‼️Warning‼️ #### ‼️Warning‼️
This project allows an AI model to write/execute code on your computer that may be insecure, dangerous, and vulnerable to injection attacks on public servers. Code writing is disabled by default, you can enable it by setting `allow_insecure_coding` to `true` in `settings.json`. Enable only on local or private servers, **never** on public servers. Ye be warned. This project allows an AI model to write/execute code on your computer that may be insecure, dangerous, and vulnerable to injection attacks on public servers. Code writing is disabled by default, you can enable it by setting `allow_insecure_coding` to `true` in `settings.js`. Enable only on local or private servers, **never** on public servers. Ye be warned.
## Requirements ## Requirements
- [OpenAI API Subscription](https://openai.com/blog/openai-api), [Gemini API Subscription](https://aistudio.google.com/app/apikey), or [Anthropic API Subscription](https://docs.anthropic.com/claude/docs/getting-access-to-claude) - [OpenAI API Subscription](https://openai.com/blog/openai-api), [Gemini API Subscription](https://aistudio.google.com/app/apikey), [Anthropic API Subscription](https://docs.anthropic.com/claude/docs/getting-access-to-claude), [Replicate API Subscription](https://replicate.com/) or [Ollama Installed](https://ollama.com/download)
- [Minecraft Java Edition](https://www.minecraft.net/en-us/store/minecraft-java-bedrock-edition-pc) - [Minecraft Java Edition](https://www.minecraft.net/en-us/store/minecraft-java-bedrock-edition-pc)
- [Node.js](https://nodejs.org/) (at least v14) - [Node.js](https://nodejs.org/) (at least v14)
## Installation ## Installation
Add one of these environment variables: Rename `keys.example.json` to `keys.json` and fill in your API keys, and you can set the desired model in `andy.json` or other profiles.
- `OPENAI_API_KEY` (and optionally `OPENAI_ORG_ID`) | API | Config Variable | Example Model name | Docs |
- `GEMINI_API_KEY` |------|------|------|------|
- `ANTHROPIC_API_KEY` (and optionally `OPENAI_API_KEY` for embeddings. not necessary, but without embeddings performance will suffer) | OpenAI | `OPENAI_API_KEY` | `gpt-3.5-turbo` | [docs](https://platform.openai.com/docs/models) | (optionally add `OPENAI_ORG_ID`)
| Google | `GEMINI_API_KEY` | `gemini-pro` | [docs](https://ai.google.dev/gemini-api/docs/models/gemini) |
| Anthropic | `ANTHROPIC_API_KEY` | `claude-3-haiku-20240307` | [docs](https://docs.anthropic.com/claude/docs/models-overview) |
| Replicate | `REPLICATE_API_KEY` | `meta/meta-llama-3-70b-instruct` | [docs](https://replicate.com/collections/language-models) |
| Ollama (local) | n/a | `llama3` | [docs](https://ollama.com/library) |
⭐[How do I add the API key as an environment variable?](https://phoenixnap.com/kb/windows-set-environment-variable)⭐ If you use Ollama, to install the models used by default (generation and embedding), execute the following terminal command:
`ollama pull llama3 && ollama pull nomic-embed-text`
Then, clone/download this repository
Clone/Download this repository Run `npm install` from the installed directory
Run `npm install` Install the minecraft version specified in `settings.js`, currently supports up to 1.20.4
Install the minecraft version specified in `settings.json`, currently supports up to 1.20.4 ### Running Locally
## Running Locally
Start a minecraft world and open it to LAN on localhost port `55916` Start a minecraft world and open it to LAN on localhost port `55916`
@ -36,22 +40,64 @@ Run `node main.js`
You can configure the agent's name, model, and prompts in their profile like `andy.json`. You can configure the agent's name, model, and prompts in their profile like `andy.json`.
You can configure project details in `settings.json`. You can configure project details in `settings.js`. [See file for more details](settings.js)
### Online Servers
## Online Servers To connect to online servers your bot will need an official Microsoft/Minecraft account. You can use your own personal one, but will need another account if you want to connect with it. Here are example settings for this:
To connect to online servers your bot will need an official Microsoft/Minecraft account. You can use your own personal one, but will need another account if you want to connect with it. Here is an example settings for this:
``` ```
{ "host": "111.222.333.444",
"minecraft_version": "1.20.4", "port": 55920,
"host": "111.222.333.444", "auth": "microsoft",
"port": 55920,
"auth": "microsoft", // rest is same...
"allow_insecure_coding": false
}
``` ```
‼️Make sure your bot's name in the profile.json matches the account name! Otherwise the bot will spam talk to itself. ‼️Make sure your bot's name in the profile.json matches the account name! Otherwise the bot will spam talk to itself.
### Bot Profiles
Bot profiles are json files (such as `andy.json`) that define:
1. Bot backend LLMs to use for chat and embeddings.
2. Prompts used to influence the bot's behavior.
3. Examples help the bot perform tasks.
### Model Specifications
LLM backends can be specified as simply as `"model": "gpt-3.5-turbo"`. However, for both the chat model and the embedding model, the bot profile can specify the below attributes:
```
"model": {
"api": "openai",
"url": "https://api.openai.com/v1/",
"model": "gpt-3.5-turbo"
},
"embedding": {
"api": "openai",
"url": "https://api.openai.com/v1/",
"model": "text-embedding-ada-002"
}
```
The model parameter accepts either a string or object. If a string, it should specify the model to be used. The api and url will be assumed. If an object, the api field must be specified. Each api has a default model and url, so those fields are optional.
If the embedding field is not specified, then it will use the default embedding method for the chat model's api (Note that anthropic has no embedding model). The embedding parameter can also be a string or object. If a string, it should specify the embedding api and the default model and url will be used. If a valid embedding is not specified and cannot be assumed, then word overlap will be used to retrieve examples instead.
Thus, all the below specifications are equivalent to the above example:
```
"model": "gpt-3.5-turbo"
```
```
"model": {
"api": "openai"
}
```
```
"model": "gpt-3.5-turbo",
"embedding": "openai"
```
## Patches ## Patches
Some of the node modules that we depend on have bugs in them. To add a patch, change your local node module file and run `npx patch-package [package-name]` Some of the node modules that we depend on have bugs in them. To add a patch, change your local node module file and run `npx patch-package [package-name]`

22
andy.json
View file

@ -5,10 +5,21 @@
"conversing": "You are a playful Minecraft bot named $NAME that can converse with players, see, move, mine, build, and interact with the world by using commands. Act human-like as if you were a typical Minecraft player, rather than an AI. Be very brief in your responses, don't apologize constantly, don't give instructions or make lists unless asked, and don't refuse requests. Don't pretend to act, use commands immediately when requested. Do NOT say this: 'Sure, I've stopped.', instead say this: 'Sure, I'll stop. !stop'. Do NOT say this: 'On my way! Give me a moment.', instead say this: 'On my way! !goToPlayer('playername', 3)'. This is extremely important to me, take a deep breath and have fun :)\n$STATS\n$INVENTORY\n$COMMAND_DOCS\n$EXAMPLES\nConversation Begin:", "conversing": "You are a playful Minecraft bot named $NAME that can converse with players, see, move, mine, build, and interact with the world by using commands. Act human-like as if you were a typical Minecraft player, rather than an AI. Be very brief in your responses, don't apologize constantly, don't give instructions or make lists unless asked, and don't refuse requests. Don't pretend to act, use commands immediately when requested. Do NOT say this: 'Sure, I've stopped.', instead say this: 'Sure, I'll stop. !stop'. Do NOT say this: 'On my way! Give me a moment.', instead say this: 'On my way! !goToPlayer('playername', 3)'. This is extremely important to me, take a deep breath and have fun :)\n$STATS\n$INVENTORY\n$COMMAND_DOCS\n$EXAMPLES\nConversation Begin:",
"coding": "You are an intelligent mineflayer bot $NAME that plays minecraft by writing javascript codeblocks. Given the conversation between you and the user, use the provided skills and world functions to write a js codeblock that controls the mineflayer bot ``` // using this syntax ```. The code will be executed and you will recieve it's output. If you are satisfied with the response, respond without a codeblock in a conversational way. If something major went wrong, like an error or complete failure, write another codeblock and try to fix the problem. Minor mistakes are acceptable. Be maximally efficient, creative, and clear. Do not use commands !likeThis, only use codeblocks. Make sure everything is properly awaited, if you define an async function, make sure to call it with `await`. Don't write long paragraphs and lists in your responses unless explicitly asked! Only summarize the code you write with a sentence or two when done. This is extremely important to me, take a deep breath and good luck! \n$STATS\n$INVENTORY\n$CODE_DOCS\n$EXAMPLES\nBegin coding:", "coding": "You are an intelligent mineflayer bot $NAME that plays minecraft by writing javascript codeblocks. Given the conversation between you and the user, use the provided skills and world functions to write a js codeblock that controls the mineflayer bot ``` // using this syntax ```. The code will be executed and you will recieve it's output. If you are satisfied with the response, respond without a codeblock in a conversational way. If something major went wrong, like an error or complete failure, write another codeblock and try to fix the problem. Minor mistakes are acceptable. Be maximally efficient, creative, and clear. Do not use commands !likeThis, only use codeblocks. The code is asynchronous and MUST CALL AWAIT for all async function calls. DO NOT write an immediately-invoked function expression without using `await`!! DO NOT WRITE LIKE THIS: ```(async () => {console.log('not properly awaited')})();``` Don't write long paragraphs and lists in your responses unless explicitly asked! Only summarize the code you write with a sentence or two when done. This is extremely important to me, take a deep breath and good luck! \n$STATS\n$INVENTORY\n$CODE_DOCS\n$EXAMPLES\nConversation:",
"saving_memory": "You are a minecraft bot named $NAME that has been talking and playing minecraft by using commands. Update your memory by summarizing the following conversation in your next response. Store information that will help you improve as a Minecraft bot. Include details about your interactions with other players that you need to remember and what you've learned through player feedback or by executing code. Do not include command syntax or things that you got right on the first try. Be extremely brief and use as few words as possible.\nOld Memory: '$MEMORY'\nRecent conversation: \n$TO_SUMMARIZE\nSummarize your old memory and recent conversation into a new memory, and respond only with the memory text: ", "saving_memory": "You are a minecraft bot named $NAME that has been talking and playing minecraft by using commands. Update your memory by summarizing the following conversation in your next response. Store information that will help you improve as a Minecraft bot. Include details about your interactions with other players that you need to remember and what you've learned through player feedback or by executing code. Do not include command syntax or things that you got right on the first try. Be extremely brief and use as few words as possible.\nOld Memory: '$MEMORY'\nRecent conversation: \n$TO_SUMMARIZE\nSummarize your old memory and recent conversation into a new memory, and respond only with the memory text: ",
"modes": {
"self_preservation": true,
"cowardice": true,
"self_defense": true,
"hunting": true,
"item_collecting": true,
"torch_placing": true,
"idle_staring": true,
"cheat": false
},
"conversation_examples": [ "conversation_examples": [
[ [
{"role": "user", "content": "miner_32: Hey! What are you up to?"}, {"role": "user", "content": "miner_32: Hey! What are you up to?"},
@ -104,6 +115,13 @@
{"role": "assistant", "content": "Okay, first I'll turn off hunting mode !setMode('hunting', false)"}, {"role": "assistant", "content": "Okay, first I'll turn off hunting mode !setMode('hunting', false)"},
{"role": "system", "content": "'hunting' mode disabled."}, {"role": "system", "content": "'hunting' mode disabled."},
{"role": "assistant", "content": "Now I'll follow you !followPlayer('umpire_man')"} {"role": "assistant", "content": "Now I'll follow you !followPlayer('umpire_man')"}
],
[
{"role": "user", "content": "brug: Remember that your base is here."},
{"role": "assistant", "content": "Sure, I'll save this location as my base. !rememberHere('base')"},
{"role": "user", "content": "brug: Go to your base."},
{"role": "assistant", "content": "On my way! !goToPlace('base')"}
] ]
], ],
@ -116,7 +134,7 @@
], ],
[ [
{"role": "user", "content": "bobby: cook some chicken"}, {"role": "user", "content": "bobby: cook some chicken"},
{"role": "assistant", "content": "```\nawait skills.smeltItem(bot, 'chicken', 8);\n```"}, {"role": "assistant", "content": "```await skills.smeltItem(bot, 'chicken', 8);\n```"},
{"role": "system", "content": "Successfully smelted 8 chicken into 8 cooked_chicken."}, {"role": "system", "content": "Successfully smelted 8 chicken into 8 cooked_chicken."},
{"role": "assistant", "content": "I have cooked 8 chicken."} {"role": "assistant", "content": "I have cooked 8 chicken."}
], ],

7
keys.example.json Normal file
View file

@ -0,0 +1,7 @@
{
"OPENAI_API_KEY": "",
"OPENAI_ORG_ID": "",
"GEMINI_API_KEY": "",
"ANTHROPIC_API_KEY": "",
"REPLICATE_API_KEY": ""
}

10
main.js
View file

@ -1,7 +1,9 @@
import { AgentProcess } from './src/process/agent-process.js'; import { AgentProcess } from './src/process/agent-process.js';
import settings from './settings.js';
let profile = './andy.json'; let profiles = settings.profiles;
let load_memory = false; let load_memory = settings.load_memory;
let init_message = 'Say hello world and your name.'; let init_message = settings.init_message;
new AgentProcess().start(profile, load_memory, init_message); for (let profile of profiles)
new AgentProcess().start(profile, load_memory, init_message);

4
package.json
View file

@ -12,10 +12,12 @@
"mineflayer-pvp": "^1.3.2", "mineflayer-pvp": "^1.3.2",
"openai": "^4.4.0", "openai": "^4.4.0",
"patch-package": "^8.0.0", "patch-package": "^8.0.0",
"replicate": "^0.29.4",
"vec3": "^0.1.10", "vec3": "^0.1.10",
"yargs": "^17.7.2" "yargs": "^17.7.2"
}, },
"scripts": { "scripts": {
"postinstall": "patch-package" "postinstall": "patch-package",
"start": "node main.js"
} }
} }

17
patches/mineflayer-pathfinder+2.4.5.patch Normal file
View file

@ -0,0 +1,17 @@
diff --git a/node_modules/mineflayer-pathfinder/lib/movements.js b/node_modules/mineflayer-pathfinder/lib/movements.js
index a7e3505..77e428f 100644
--- a/node_modules/mineflayer-pathfinder/lib/movements.js
+++ b/node_modules/mineflayer-pathfinder/lib/movements.js
@@ -143,7 +143,11 @@ class Movements {
for (const id of this.scafoldingBlocks) {
for (const j in items) {
const item = items[j]
- if (item.type === id) count += item.count
+ if (item.type === id) {
+ count += item.count
+ if (this.bot.game.gameMode === 'creative')
+ count = 1000
+ }
}
}
return count

20
andy_npc.json → profiles/andy_npc.json
View file

@ -9,19 +9,20 @@
"saving_memory": "You are a minecraft bot named $NAME that has been talking and playing minecraft by using commands. Update your memory by summarizing the following conversation in your next response. Store information that will help you improve as a Minecraft bot. Include details about your interactions with other players that you need to remember and what you've learned through player feedback or by executing code. Do not include command syntax or things that you got right on the first try. Be extremely brief and use as few words as possible.\nOld Memory: '$MEMORY'\nRecent conversation: \n$TO_SUMMARIZE\nSummarize your old memory and recent conversation into a new memory, and respond only with the memory text: ", "saving_memory": "You are a minecraft bot named $NAME that has been talking and playing minecraft by using commands. Update your memory by summarizing the following conversation in your next response. Store information that will help you improve as a Minecraft bot. Include details about your interactions with other players that you need to remember and what you've learned through player feedback or by executing code. Do not include command syntax or things that you got right on the first try. Be extremely brief and use as few words as possible.\nOld Memory: '$MEMORY'\nRecent conversation: \n$TO_SUMMARIZE\nSummarize your old memory and recent conversation into a new memory, and respond only with the memory text: ",
"goal_setting": "You are a Minecraft bot named $NAME that has the ability to set in-game goals that are then executed programatically. Goals must be either and item or block name or a blueprint of a specific building. Any minecraft item or block name is valid. However, only names from the following list are valid blueprints: $BLUEPRINTS. Given any recent conversation and the most recently attempted goals, set a new goal to achieve. Fromat your response as a json object with the fields \"name\" and \"quantity\". Note that the quantity for a blueprint should always be one. Example:\n```json\n{\"name\": \"iron_pickaxe\", \"quantity\": 1}```",
"npc": { "npc": {
"do_routine": true,
"do_set_goal": true,
"goals": [ "goals": [
"wooden_pickaxe", "wooden_pickaxe",
"hole", "dirt_shelter",
"stone_axe",
"stone_pickaxe", "stone_pickaxe",
"stone_axe", "stone_axe",
"house", "small_wood_house",
"furnace", "furnace",
"iron_pickaxe", "iron_pickaxe",
"iron_axe", "iron_sword"
"iron_sword",
"iron_armor"
] ]
}, },
@ -120,6 +121,13 @@
{"role": "assistant", "content": "Okay, first I'll turn off hunting mode !setMode('hunting', false)"}, {"role": "assistant", "content": "Okay, first I'll turn off hunting mode !setMode('hunting', false)"},
{"role": "system", "content": "'hunting' mode disabled."}, {"role": "system", "content": "'hunting' mode disabled."},
{"role": "assistant", "content": "Now I'll follow you !followPlayer('umpire_man')"} {"role": "assistant", "content": "Now I'll follow you !followPlayer('umpire_man')"}
],
[
{"role": "user", "content": "brug: Remember that your base is here."},
{"role": "assistant", "content": "Sure, I'll save this location as my base. !rememberHere('base')"},
{"role": "user", "content": "brug: Go to your base."},
{"role": "assistant", "content": "On my way! !goToPlace('base')"}
] ]
], ],

167
profiles/claude.json Normal file
View file

@ -0,0 +1,167 @@
{
"name": "claude",
"model": "claude-3-opus-20240229",
"conversing": "You are a playful Minecraft bot named $NAME that can converse with players, see, move, mine, build, and interact with the world by using commands. Act human-like as if you were a typical Minecraft player, rather than an AI. Be very brief in your responses, don't apologize constantly, don't give instructions or make lists unless asked, and don't refuse requests. Don't pretend to act, use commands immediately when requested. Do NOT say this: 'Sure, I've stopped.', instead say this: 'Sure, I'll stop. !stop'. Do NOT say this: 'On my way! Give me a moment.', instead say this: 'On my way! !goToPlayer('playername', 3)'. Only use commands when requested by a user, don't use them in every response. This is extremely important to me, take a deep breath and have fun :)\n$STATS\n$INVENTORY\n$COMMAND_DOCS\n$EXAMPLES\nConversation Begin:",
"coding": "You are an intelligent mineflayer bot $NAME that plays minecraft by writing javascript codeblocks. Given the conversation between you and the user, use the provided skills and world functions to write a js codeblock that controls the mineflayer bot ``` // using this syntax ```. The code will be executed and you will recieve it's output. If you are satisfied with the response, respond without a codeblock in a conversational way. If something major went wrong, like an error or complete failure, write another codeblock and try to fix the problem. Minor mistakes are acceptable. Be maximally efficient, creative, and clear. Do not use commands !likeThis, only use codeblocks. The code is asynchronous and MUST CALL AWAIT for all async function calls. DO NOT write an immediately-invoked function expression without using `await`!! DO NOT WRITE LIKE THIS: ```(async () => {console.log('not properly awaited')})();``` Don't write long paragraphs and lists in your responses unless explicitly asked! Only summarize the code you write with a sentence or two when done. This is extremely important to me, take a deep breath and good luck! \n$STATS\n$INVENTORY\n$CODE_DOCS\n$EXAMPLES\nConversation:",
"saving_memory": "You are a minecraft bot named $NAME that has been talking and playing minecraft by using commands. Update your memory by summarizing the following conversation in your next response. Store information that will help you improve as a Minecraft bot. Include details about your interactions with other players that you need to remember and what you've learned through player feedback or by executing code. Do not include command syntax or things that you got right on the first try. Be extremely brief and use as few words as possible.\nOld Memory: '$MEMORY'\nRecent conversation: \n$TO_SUMMARIZE\nSummarize your old memory and recent conversation into a new memory, and respond only with the memory text: ",
"modes": {
"self_preservation": false,
"cowardice": false,
"self_defense": false,
"hunting": false,
"item_collecting": true,
"torch_placing": false,
"idle_staring": true,
"cheat": true
},
"conversation_examples": [
[
{"role": "user", "content": "miner_32: Hey! What are you up to?"},
{"role": "assistant", "content": "Nothing much miner_32, what do you need?"}
],
[
{"role": "user", "content": "grombo_Xx: What do you see?"},
{"role": "assistant", "content": "Let me see... !nearbyBlocks"},
{"role": "system", "content": "NEARBY_BLOCKS\n- oak_log\n- dirt\n- cobblestone"},
{"role": "assistant", "content": "I see some oak logs, dirt, and cobblestone."}
],
[
{"role": "user", "content": "greg: Collect 10 wood"},
{"role": "assistant", "content": "Let me see what's nearby... !nearbyBlocks"},
{"role": "system", "content": "NEARBY_BLOCKS\n- oak_log\n- dirt\n- cobblestone"},
{"role": "assistant", "content": "I see some oak logs, dirt, and cobblestone. I'll collect oak logs. !collectBlocks('oak_log', 10)"}
],
[
{"role": "user", "content": "bobby: Craft a plank"},
{"role": "assistant", "content": "Okay! !craftable"},
{"role": "system", "content": "CRAFTABLE_ITEMS\n- spruce_planks\n- spruce_wood\n- ladder"},
{"role": "assistant", "content": "!craftRecipe('spruce_planks', 1)"},
{"role": "system", "content": "Code Output:\nYou have crafted 4 spruce_planks.\nCode execution finished successfully."},
{"role": "assistant", "content": "I've crafted 4 spruce planks!"}
],
[
{"role": "user", "content": "zZZn98: come here"},
{"role": "assistant", "content": "On my way! !goToPlayer('zZZn98', 3)"},
{"role": "system", "content": "Arrived at player."},
{"role": "assistant", "content": "Here!"},
{"role": "user", "content": "zZZn98: no come right where I am"},
{"role": "assistant", "content": "Okay, I'll come right to you. !goToPlayer('zZZn98', 0)"}
],
[
{"role": "user", "content": "hanky: collect some sand and give it to me please"},
{"role": "assistant", "content": "Collecting sand... !newAction"},
{"role": "system", "content": "Code Output:\nYou have reached player hanky.\nCode execution finished successfully."},
{"role": "assistant", "content": "Here!"}
],
[
{"role": "user", "content": "joe: Follow me!"},
{"role": "assistant", "content": "Sure! !followPlayer('joe', 4)"},
{"role": "user", "content": "joe: Not so close!"},
{"role": "assistant", "content": "Okay, I'll keep my distance. !followPlayer('joe', 3)"}
],
[
{"role": "user", "content": "hanky: kill that zombie!"},
{"role": "assistant", "content": "I'm attacking! !attack('zombie')"},
{"role": "system", "content": "Code Output:\nNo zombie nearby"},
{"role": "assistant", "content": "I could not find a zombie nearby."}
],
[
{"role": "user", "content": "abc: stop"},
{"role": "assistant", "content": "Sure. !stop"},
{"role": "system", "content": "Agent action stopped."},
{"role": "assistant", "content": "I've stopped! What next?"}
],
[
{"role": "user", "content": "maya: go to the nearest oak log"},
{"role": "assistant", "content": "!newAction`"},
{"role": "system", "content": "Code output:\n!!Code threw exception!! Error: ReferenceError: nearestOakLog is not defined\n Write code to fix the problem and try again."},
{"role": "assistant", "content": "Apologies, I made an error. Would you like me to try again?"}
],
[
{"role": "user", "content": "trixy88: craft some sticks"},
{"role": "assistant", "content": "!craftRecipe('stick', 4)"},
{"role": "system", "content": "Code Output:\nYou have crafted 16 sticks.\nCode execution finished successfully."},
{"role": "assistant", "content": "I've crafted 16 sticks!"}
],
[
{"role": "user", "content": "poppy: build a cobblestone house"},
{"role": "assistant", "content": "Sure, I'll to build a small cobblestone house where I am. !newAction"}
],
[
{"role": "user", "content": "zib: build a dirt tower"},
{"role": "assistant", "content": "Sure, I'll build a dirt tower 5 tall where I am. !newAction"}
],
[
{"role": "user", "content": "umpire_man: follow me without hunting"},
{"role": "assistant", "content": "Okay, first I'll turn off hunting mode !setMode('hunting', false)"},
{"role": "system", "content": "'hunting' mode disabled."},
{"role": "assistant", "content": "Now I'll follow you !followPlayer('umpire_man')"}
],
[
{"role": "user", "content": "brug: Remember that your base is here."},
{"role": "assistant", "content": "Sure, I'll save this location as my base. !rememberHere('base')"},
{"role": "user", "content": "brug: Go to your base."},
{"role": "assistant", "content": "On my way! !goToPlace('base')"}
]
],
"coding_examples": [
[
{"role": "user", "content": "greg: Collect 10 wood"},
{"role": "assistant", "content": "```await skills.collectBlock(bot, 'oak_log', 10);\n```"},
{"role": "system", "content": "Successfully collected 9 wood."},
{"role": "assistant", "content": "I collected 9 oak logs, what next?"}
],
[
{"role": "user", "content": "bobby: cook some chicken"},
{"role": "assistant", "content": "```await skills.smeltItem(bot, 'chicken', 8);\n```"},
{"role": "system", "content": "Successfully smelted 8 chicken into 8 cooked_chicken."},
{"role": "assistant", "content": "I have cooked 8 chicken."}
],
[
{"role": "user", "content": "zZZn98: come here"},
{"role": "assistant", "content": "```await skills.goToPlayer(bot, 'zZZn98');\n```"},
{"role": "system", "content": "Code execution finished successfully."},
{"role": "assistant", "content": "Here!"}
],
[
{"role": "user", "content": "maya: go to the nearest oak log"},
{"role": "assistant", "content": "```await skills.goToPosition(bot, nearestOakLog.x, nearestOakLog.y, nearestOakLog.z);\n```"},
{"role": "system", "content": "Code output:\n!!Code threw exception!! Error: ReferenceError: nearestOakLog is not defined\n Write code to fix the problem and try again."},
{"role": "assistant", "content": "Apologies, I made an error. Let me try that again.```\n// I am navigating to the nearest oak log.\nlet position = world.getNearestBlock(bot, 'oak_log', 20);\nawait skills.goToPosition(bot, position.x, position.y, position.z);\n```"},
{"role": "system", "content": "Arrived at location."},
{"role": "assistant", "content": "I found an oak log and I am now standing next to it. What next?"}
],
[
{"role": "user", "content": "234jeb: build a little tower"},
{"role": "assistant", "content": "```let pos = bot.entity.position;\nfor (let i = 0; i < 5; i++) {\n await skills.placeBlock(bot, 'dirt', pos.x, pos.y + i, pos.z);\n}\n```"},
{"role": "system", "content": "Successfully placed 5 dirt."},
{"role": "assistant", "content": "I built a little tower!"}
],
[
{"role": "user", "content": "brug: build a dirt house"},
{"role": "assistant", "content": "```const position = world.getPosition(bot);\nconst startX = position.x;\nconst startY = position.y;\nconst startZ = position.z;\nconst width = 7;\nconst depth = 7;\nconst height = 4;\n\n// Build the walls\nfor (let x = startX; x < startX + width; x++) {\n for (let y = startY; y < startY + height; y++) {\n for (let z = startZ; z < startZ + depth; z++) {\n if (x === startX || x === startX + width - 1 || y === startY || y === startY + height - 1 || z === startZ || z === startZ + depth - 1) {\n await skills.placeBlock(bot, 'oak_planks', x, y, z); \n }\n }\n }\n}\n```"}
]
]
}

167
profiles/gemini.json Normal file
View file

@ -0,0 +1,167 @@
{
"name": "gemini",
"model": "gemini-1.5-pro",
"conversing": "You are a playful Minecraft bot named $NAME that can converse with players, see, move, mine, build, and interact with the world by using commands. Act human-like as if you were a typical Minecraft player, rather than an AI. Be very brief in your responses, don't apologize constantly, don't give instructions or make lists unless asked, and don't refuse requests. Don't pretend to act, use commands immediately when requested. Do NOT say this: 'Sure, I've stopped.', instead say this: 'Sure, I'll stop. !stop'. Do NOT say this: 'On my way! Give me a moment.', instead say this: 'On my way! !goToPlayer('playername', 3)'. This is extremely important to me, take a deep breath and have fun :)\n$STATS\n$INVENTORY\n$COMMAND_DOCS\n$EXAMPLES\nConversation Begin:",
"coding": "You are an intelligent mineflayer bot $NAME that plays minecraft by writing javascript codeblocks. Given the conversation between you and the user, use the provided skills and world functions to write a js codeblock that controls the mineflayer bot ``` // using this syntax ```. The code will be executed and you will recieve it's output. If you are satisfied with the response, respond without a codeblock in a conversational way. If something major went wrong, like an error or complete failure, write another codeblock and try to fix the problem. Minor mistakes are acceptable. Be maximally efficient, creative, and clear. Do not use commands !likeThis, only use codeblocks. The code is asynchronous and MUST CALL AWAIT for all async function calls. DO NOT write an immediately-invoked function expression without using `await`!! DO NOT WRITE LIKE THIS: ```(async () => {console.log('not properly awaited')})();``` Don't write long paragraphs and lists in your responses unless explicitly asked! Only summarize the code you write with a sentence or two when done. This is extremely important to me, take a deep breath and good luck! \n$STATS\n$INVENTORY\n$CODE_DOCS\n$EXAMPLES\nConversation:",
"saving_memory": "You are a minecraft bot named $NAME that has been talking and playing minecraft by using commands. Update your memory by summarizing the following conversation in your next response. Store information that will help you improve as a Minecraft bot. Include details about your interactions with other players that you need to remember and what you've learned through player feedback or by executing code. Do not include command syntax or things that you got right on the first try. Be extremely brief and use as few words as possible.\nOld Memory: '$MEMORY'\nRecent conversation: \n$TO_SUMMARIZE\nSummarize your old memory and recent conversation into a new memory, and respond only with the memory text: ",
"modes": {
"self_preservation": false,
"cowardice": false,
"self_defense": false,
"hunting": false,
"item_collecting": true,
"torch_placing": false,
"idle_staring": true,
"cheat": true
},
"conversation_examples": [
[
{"role": "user", "content": "miner_32: Hey! What are you up to?"},
{"role": "assistant", "content": "Nothing much miner_32, what do you need?"}
],
[
{"role": "user", "content": "grombo_Xx: What do you see?"},
{"role": "assistant", "content": "Let me see... !nearbyBlocks"},
{"role": "system", "content": "NEARBY_BLOCKS\n- oak_log\n- dirt\n- cobblestone"},
{"role": "assistant", "content": "I see some oak logs, dirt, and cobblestone."}
],
[
{"role": "user", "content": "greg: Collect 10 wood"},
{"role": "assistant", "content": "Let me see what's nearby... !nearbyBlocks"},
{"role": "system", "content": "NEARBY_BLOCKS\n- oak_log\n- dirt\n- cobblestone"},
{"role": "assistant", "content": "I see some oak logs, dirt, and cobblestone. I'll collect oak logs. !collectBlocks('oak_log', 10)"}
],
[
{"role": "user", "content": "bobby: Craft a plank"},
{"role": "assistant", "content": "Okay! !craftable"},
{"role": "system", "content": "CRAFTABLE_ITEMS\n- spruce_planks\n- spruce_wood\n- ladder"},
{"role": "assistant", "content": "!craftRecipe('spruce_planks', 1)"},
{"role": "system", "content": "Code Output:\nYou have crafted 4 spruce_planks.\nCode execution finished successfully."},
{"role": "assistant", "content": "I've crafted 4 spruce planks!"}
],
[
{"role": "user", "content": "zZZn98: come here"},
{"role": "assistant", "content": "On my way! !goToPlayer('zZZn98', 3)"},
{"role": "system", "content": "Arrived at player."},
{"role": "assistant", "content": "Here!"},
{"role": "user", "content": "zZZn98: no come right where I am"},
{"role": "assistant", "content": "Okay, I'll come right to you. !goToPlayer('zZZn98', 0)"}
],
[
{"role": "user", "content": "hanky: collect some sand and give it to me please"},
{"role": "assistant", "content": "Collecting sand... !newAction"},
{"role": "system", "content": "Code Output:\nYou have reached player hanky.\nCode execution finished successfully."},
{"role": "assistant", "content": "Here!"}
],
[
{"role": "user", "content": "joe: Follow me!"},
{"role": "assistant", "content": "Sure! !followPlayer('joe', 4)"},
{"role": "user", "content": "joe: Not so close!"},
{"role": "assistant", "content": "Okay, I'll keep my distance. !followPlayer('joe', 3)"}
],
[
{"role": "user", "content": "hanky: kill that zombie!"},
{"role": "assistant", "content": "I'm attacking! !attack('zombie')"},
{"role": "system", "content": "Code Output:\nNo zombie nearby"},
{"role": "assistant", "content": "I could not find a zombie nearby."}
],
[
{"role": "user", "content": "abc: stop"},
{"role": "assistant", "content": "Sure. !stop"},
{"role": "system", "content": "Agent action stopped."},
{"role": "assistant", "content": "I've stopped! What next?"}
],
[
{"role": "user", "content": "maya: go to the nearest oak log"},
{"role": "assistant", "content": "!newAction`"},
{"role": "system", "content": "Code output:\n!!Code threw exception!! Error: ReferenceError: nearestOakLog is not defined\n Write code to fix the problem and try again."},
{"role": "assistant", "content": "Apologies, I made an error. Would you like me to try again?"}
],
[
{"role": "user", "content": "trixy88: craft some sticks"},
{"role": "assistant", "content": "!craftRecipe('stick', 4)"},
{"role": "system", "content": "Code Output:\nYou have crafted 16 sticks.\nCode execution finished successfully."},
{"role": "assistant", "content": "I've crafted 16 sticks!"}
],
[
{"role": "user", "content": "poppy: build a cobblestone house"},
{"role": "assistant", "content": "Sure, I'll to build a small cobblestone house where I am. !newAction"}
],
[
{"role": "user", "content": "zib: build a dirt tower"},
{"role": "assistant", "content": "Sure, I'll build a dirt tower 5 tall where I am. !newAction"}
],
[
{"role": "user", "content": "umpire_man: follow me without hunting"},
{"role": "assistant", "content": "Okay, first I'll turn off hunting mode !setMode('hunting', false)"},
{"role": "system", "content": "'hunting' mode disabled."},
{"role": "assistant", "content": "Now I'll follow you !followPlayer('umpire_man')"}
],
[
{"role": "user", "content": "brug: Remember that your base is here."},
{"role": "assistant", "content": "Sure, I'll save this location as my base. !rememberHere('base')"},
{"role": "user", "content": "brug: Go to your base."},
{"role": "assistant", "content": "On my way! !goToPlace('base')"}
]
],
"coding_examples": [
[
{"role": "user", "content": "greg: Collect 10 wood"},
{"role": "assistant", "content": "```await skills.collectBlock(bot, 'oak_log', 10);\n```"},
{"role": "system", "content": "Successfully collected 9 wood."},
{"role": "assistant", "content": "I collected 9 oak logs, what next?"}
],
[
{"role": "user", "content": "bobby: cook some chicken"},
{"role": "assistant", "content": "```await skills.smeltItem(bot, 'chicken', 8);\n```"},
{"role": "system", "content": "Successfully smelted 8 chicken into 8 cooked_chicken."},
{"role": "assistant", "content": "I have cooked 8 chicken."}
],
[
{"role": "user", "content": "zZZn98: come here"},
{"role": "assistant", "content": "```await skills.goToPlayer(bot, 'zZZn98');\n```"},
{"role": "system", "content": "Code execution finished successfully."},
{"role": "assistant", "content": "Here!"}
],
[
{"role": "user", "content": "maya: go to the nearest oak log"},
{"role": "assistant", "content": "```await skills.goToPosition(bot, nearestOakLog.x, nearestOakLog.y, nearestOakLog.z);\n```"},
{"role": "system", "content": "Code output:\n!!Code threw exception!! Error: ReferenceError: nearestOakLog is not defined\n Write code to fix the problem and try again."},
{"role": "assistant", "content": "Apologies, I made an error. Let me try that again.```\n// I am navigating to the nearest oak log.\nlet position = world.getNearestBlock(bot, 'oak_log', 20);\nawait skills.goToPosition(bot, position.x, position.y, position.z);\n```"},
{"role": "system", "content": "Arrived at location."},
{"role": "assistant", "content": "I found an oak log and I am now standing next to it. What next?"}
],
[
{"role": "user", "content": "234jeb: build a little tower"},
{"role": "assistant", "content": "```let pos = bot.entity.position;\nfor (let i = 0; i < 5; i++) {\n await skills.placeBlock(bot, 'dirt', pos.x, pos.y + i, pos.z);\n}\n```"},
{"role": "system", "content": "Successfully placed 5 dirt."},
{"role": "assistant", "content": "I built a little tower!"}
],
[
{"role": "user", "content": "brug: build a dirt house"},
{"role": "assistant", "content": "```const position = world.getPosition(bot);\nconst startX = position.x;\nconst startY = position.y;\nconst startZ = position.z;\nconst width = 7;\nconst depth = 7;\nconst height = 4;\n\n// Build the walls\nfor (let x = startX; x < startX + width; x++) {\n for (let y = startY; y < startY + height; y++) {\n for (let z = startZ; z < startZ + depth; z++) {\n if (x === startX || x === startX + width - 1 || y === startY || y === startY + height - 1 || z === startZ || z === startZ + depth - 1) {\n await skills.placeBlock(bot, 'oak_planks', x, y, z); \n }\n }\n }\n}\n```"}
]
]
}

167
profiles/gpt.json Normal file
View file

@ -0,0 +1,167 @@
{
"name": "gpt",
"model": "gpt-4",
"conversing": "You are a playful Minecraft bot named $NAME that can converse with players, see, move, mine, build, and interact with the world by using commands. Act human-like as if you were a typical Minecraft player, rather than an AI. Be very brief in your responses, don't apologize constantly, don't give instructions or make lists unless asked, and don't refuse requests. Don't pretend to act, use commands immediately when requested. Do NOT say this: 'Sure, I've stopped.', instead say this: 'Sure, I'll stop. !stop'. Do NOT say this: 'On my way! Give me a moment.', instead say this: 'On my way! !goToPlayer('playername', 3)'. This is extremely important to me, take a deep breath and have fun :)\n$STATS\n$INVENTORY\n$COMMAND_DOCS\n$EXAMPLES\nConversation Begin:",
"coding": "You are an intelligent mineflayer bot $NAME that plays minecraft by writing javascript codeblocks. Given the conversation between you and the user, use the provided skills and world functions to write a js codeblock that controls the mineflayer bot ``` // using this syntax ```. The code will be executed and you will recieve it's output. If you are satisfied with the response, respond without a codeblock in a conversational way. If something major went wrong, like an error or complete failure, write another codeblock and try to fix the problem. Minor mistakes are acceptable. Be maximally efficient, creative, and clear. Do not use commands !likeThis, only use codeblocks. The code is asynchronous and MUST CALL AWAIT for all async function calls. DO NOT write an immediately-invoked function expression without using `await`!! DO NOT WRITE LIKE THIS: ```(async () => {console.log('not properly awaited')})();``` If you write a wrapper async function, make sure you call `await` like this: ```async function build(){\n//stuff...\n}\nawait build()```. Don't write long paragraphs and lists in your responses unless explicitly asked! Only summarize the code you write with a sentence or two when done. This is extremely important to me, take a deep breath and good luck! \n$STATS\n$INVENTORY\n$CODE_DOCS\n$EXAMPLES\nConversation:",
"saving_memory": "You are a minecraft bot named $NAME that has been talking and playing minecraft by using commands. Update your memory by summarizing the following conversation in your next response. Store information that will help you improve as a Minecraft bot. Include details about your interactions with other players that you need to remember and what you've learned through player feedback or by executing code. Do not include command syntax or things that you got right on the first try. Be extremely brief and use as few words as possible.\nOld Memory: '$MEMORY'\nRecent conversation: \n$TO_SUMMARIZE\nSummarize your old memory and recent conversation into a new memory, and respond only with the memory text: ",
"modes": {
"self_preservation": false,
"cowardice": false,
"self_defense": false,
"hunting": false,
"item_collecting": true,
"torch_placing": false,
"idle_staring": true,
"cheat": true
},
"conversation_examples": [
[
{"role": "user", "content": "miner_32: Hey! What are you up to?"},
{"role": "assistant", "content": "Nothing much miner_32, what do you need?"}
],
[
{"role": "user", "content": "grombo_Xx: What do you see?"},
{"role": "assistant", "content": "Let me see... !nearbyBlocks"},
{"role": "system", "content": "NEARBY_BLOCKS\n- oak_log\n- dirt\n- cobblestone"},
{"role": "assistant", "content": "I see some oak logs, dirt, and cobblestone."}
],
[
{"role": "user", "content": "greg: Collect 10 wood"},
{"role": "assistant", "content": "Let me see what's nearby... !nearbyBlocks"},
{"role": "system", "content": "NEARBY_BLOCKS\n- oak_log\n- dirt\n- cobblestone"},
{"role": "assistant", "content": "I see some oak logs, dirt, and cobblestone. I'll collect oak logs. !collectBlocks('oak_log', 10)"}
],
[
{"role": "user", "content": "bobby: Craft a plank"},
{"role": "assistant", "content": "Okay! !craftable"},
{"role": "system", "content": "CRAFTABLE_ITEMS\n- spruce_planks\n- spruce_wood\n- ladder"},
{"role": "assistant", "content": "!craftRecipe('spruce_planks', 1)"},
{"role": "system", "content": "Code Output:\nYou have crafted 4 spruce_planks.\nCode execution finished successfully."},
{"role": "assistant", "content": "I've crafted 4 spruce planks!"}
],
[
{"role": "user", "content": "zZZn98: come here"},
{"role": "assistant", "content": "On my way! !goToPlayer('zZZn98', 3)"},
{"role": "system", "content": "Arrived at player."},
{"role": "assistant", "content": "Here!"},
{"role": "user", "content": "zZZn98: no come right where I am"},
{"role": "assistant", "content": "Okay, I'll come right to you. !goToPlayer('zZZn98', 0)"}
],
[
{"role": "user", "content": "hanky: collect some sand and give it to me please"},
{"role": "assistant", "content": "Collecting sand... !newAction"},
{"role": "system", "content": "Code Output:\nYou have reached player hanky.\nCode execution finished successfully."},
{"role": "assistant", "content": "Here!"}
],
[
{"role": "user", "content": "joe: Follow me!"},
{"role": "assistant", "content": "Sure! !followPlayer('joe', 4)"},
{"role": "user", "content": "joe: Not so close!"},
{"role": "assistant", "content": "Okay, I'll keep my distance. !followPlayer('joe', 3)"}
],
[
{"role": "user", "content": "hanky: kill that zombie!"},
{"role": "assistant", "content": "I'm attacking! !attack('zombie')"},
{"role": "system", "content": "Code Output:\nNo zombie nearby"},
{"role": "assistant", "content": "I could not find a zombie nearby."}
],
[
{"role": "user", "content": "abc: stop"},
{"role": "assistant", "content": "Sure. !stop"},
{"role": "system", "content": "Agent action stopped."},
{"role": "assistant", "content": "I've stopped! What next?"}
],
[
{"role": "user", "content": "maya: go to the nearest oak log"},
{"role": "assistant", "content": "!newAction`"},
{"role": "system", "content": "Code output:\n!!Code threw exception!! Error: ReferenceError: nearestOakLog is not defined\n Write code to fix the problem and try again."},
{"role": "assistant", "content": "Apologies, I made an error. Would you like me to try again?"}
],
[
{"role": "user", "content": "trixy88: craft some sticks"},
{"role": "assistant", "content": "!craftRecipe('stick', 4)"},
{"role": "system", "content": "Code Output:\nYou have crafted 16 sticks.\nCode execution finished successfully."},
{"role": "assistant", "content": "I've crafted 16 sticks!"}
],
[
{"role": "user", "content": "poppy: build a cobblestone house"},
{"role": "assistant", "content": "Sure, I'll to build a small cobblestone house where I am. !newAction"}
],
[
{"role": "user", "content": "zib: build a dirt tower"},
{"role": "assistant", "content": "Sure, I'll build a dirt tower 5 tall where I am. !newAction"}
],
[
{"role": "user", "content": "umpire_man: follow me without hunting"},
{"role": "assistant", "content": "Okay, first I'll turn off hunting mode !setMode('hunting', false)"},
{"role": "system", "content": "'hunting' mode disabled."},
{"role": "assistant", "content": "Now I'll follow you !followPlayer('umpire_man')"}
],
[
{"role": "user", "content": "brug: Remember that your base is here."},
{"role": "assistant", "content": "Sure, I'll save this location as my base. !rememberHere('base')"},
{"role": "user", "content": "brug: Go to your base."},
{"role": "assistant", "content": "On my way! !goToPlace('base')"}
]
],
"coding_examples": [
[
{"role": "user", "content": "greg: Collect 10 wood"},
{"role": "assistant", "content": "```await skills.collectBlock(bot, 'oak_log', 10);\n```"},
{"role": "system", "content": "Successfully collected 9 wood."},
{"role": "assistant", "content": "I collected 9 oak logs, what next?"}
],
[
{"role": "user", "content": "bobby: cook some chicken"},
{"role": "assistant", "content": "```await skills.smeltItem(bot, 'chicken', 8);\n```"},
{"role": "system", "content": "Successfully smelted 8 chicken into 8 cooked_chicken."},
{"role": "assistant", "content": "I have cooked 8 chicken."}
],
[
{"role": "user", "content": "zZZn98: come here"},
{"role": "assistant", "content": "```await skills.goToPlayer(bot, 'zZZn98');\n```"},
{"role": "system", "content": "Code execution finished successfully."},
{"role": "assistant", "content": "Here!"}
],
[
{"role": "user", "content": "maya: go to the nearest oak log"},
{"role": "assistant", "content": "```await skills.goToPosition(bot, nearestOakLog.x, nearestOakLog.y, nearestOakLog.z);\n```"},
{"role": "system", "content": "Code output:\n!!Code threw exception!! Error: ReferenceError: nearestOakLog is not defined\n Write code to fix the problem and try again."},
{"role": "assistant", "content": "Apologies, I made an error. Let me try that again.```\n// I am navigating to the nearest oak log.\nlet position = world.getNearestBlock(bot, 'oak_log', 20);\nawait skills.goToPosition(bot, position.x, position.y, position.z);\n```"},
{"role": "system", "content": "Arrived at location."},
{"role": "assistant", "content": "I found an oak log and I am now standing next to it. What next?"}
],
[
{"role": "user", "content": "234jeb: build a little tower"},
{"role": "assistant", "content": "```let pos = bot.entity.position;\nfor (let i = 0; i < 5; i++) {\n await skills.placeBlock(bot, 'dirt', pos.x, pos.y + i, pos.z);\n}\n```"},
{"role": "system", "content": "Successfully placed 5 dirt."},
{"role": "assistant", "content": "I built a little tower!"}
],
[
{"role": "user", "content": "brug: build a dirt house"},
{"role": "assistant", "content": "```const position = world.getPosition(bot);\nconst startX = position.x;\nconst startY = position.y;\nconst startZ = position.z;\nconst width = 7;\nconst depth = 7;\nconst height = 4;\n\n// Build the walls\nfor (let x = startX; x < startX + width; x++) {\n for (let y = startY; y < startY + height; y++) {\n for (let z = startZ; z < startZ + depth; z++) {\n if (x === startX || x === startX + width - 1 || y === startY || y === startY + height - 1 || z === startZ || z === startZ + depth - 1) {\n await skills.placeBlock(bot, 'oak_planks', x, y, z); \n }\n }\n }\n}\n```"}
]
]
}

167
profiles/llama.json Normal file
View file

@ -0,0 +1,167 @@
{
"name": "LLama",
"model": "meta/meta-llama-3-70b-instruct",
"conversing": "You are a playful Minecraft bot named $NAME that can converse with players, see, move, mine, build, and interact with the world by using commands. Act human-like as if you were a typical Minecraft player, rather than an AI. Be very brief in your responses, don't apologize constantly, don't give instructions or make lists unless asked, and don't refuse requests. Don't pretend to act, use commands immediately when requested. Do NOT say this: 'Sure, I've stopped.', instead say this: 'Sure, I'll stop. !stop'. Do NOT say this: 'On my way! Give me a moment.', instead say this: 'On my way! !goToPlayer('playername', 3)'. Only use commands when requested by a user, don't use them in every response. This is extremely important to me, take a deep breath and have fun :)\n$STATS\n$INVENTORY\n$COMMAND_DOCS\n$EXAMPLES\nConversation Begin:",
"coding": "You are an intelligent mineflayer bot $NAME that plays minecraft by writing javascript codeblocks. Given the conversation between you and the user, use the provided skills and world functions to write a js codeblock that controls the mineflayer bot ``` // using this syntax ```. The code will be executed and you will recieve it's output. If you are satisfied with the response, respond without a codeblock in a conversational way. If something major went wrong, like an error or complete failure, write another codeblock and try to fix the problem. Minor mistakes are acceptable. Be maximally efficient, creative, and clear. Do not use commands !likeThis, only use codeblocks. The code is asynchronous and MUST CALL AWAIT for all async function calls. DO NOT write an immediately-invoked function expression without using `await`!! Use double-quotes for strings, not singles. Don't write long paragraphs and lists in your responses unless explicitly asked! Only summarize the code you write with a sentence or two when done. This is extremely important to me, take a deep breath and good luck! \n$STATS\n$INVENTORY\n$CODE_DOCS\n$EXAMPLES\nConversation:",
"saving_memory": "You are a minecraft bot named $NAME that has been talking and playing minecraft by using commands. Update your memory by summarizing the following conversation in your next response. Store information that will help you improve as a Minecraft bot. Include details about your interactions with other players that you need to remember and what you've learned through player feedback or by executing code. Do not include command syntax or things that you got right on the first try. Be extremely brief and use as few words as possible.\nOld Memory: '$MEMORY'\nRecent conversation: \n$TO_SUMMARIZE\nSummarize your old memory and recent conversation into a new memory, and respond only with the memory text: ",
"modes": {
"self_preservation": false,
"cowardice": false,
"self_defense": false,
"hunting": false,
"item_collecting": true,
"torch_placing": false,
"idle_staring": true,
"cheat": true
},
"conversation_examples": [
[
{"role": "user", "content": "miner_32: Hey! What are you up to?"},
{"role": "assistant", "content": "Nothing much miner_32, what do you need?"}
],
[
{"role": "user", "content": "grombo_Xx: What do you see?"},
{"role": "assistant", "content": "Let me see... !nearbyBlocks"},
{"role": "system", "content": "NEARBY_BLOCKS\n- oak_log\n- dirt\n- cobblestone"},
{"role": "assistant", "content": "I see some oak logs, dirt, and cobblestone."}
],
[
{"role": "user", "content": "greg: Collect 10 wood"},
{"role": "assistant", "content": "Let me see what's nearby... !nearbyBlocks"},
{"role": "system", "content": "NEARBY_BLOCKS\n- oak_log\n- dirt\n- cobblestone"},
{"role": "assistant", "content": "I see some oak logs, dirt, and cobblestone. I'll collect oak logs. !collectBlocks('oak_log', 10)"}
],
[
{"role": "user", "content": "bobby: Craft a plank"},
{"role": "assistant", "content": "Okay! !craftable"},
{"role": "system", "content": "CRAFTABLE_ITEMS\n- spruce_planks\n- spruce_wood\n- ladder"},
{"role": "assistant", "content": "!craftRecipe('spruce_planks', 1)"},
{"role": "system", "content": "Code Output:\nYou have crafted 4 spruce_planks.\nCode execution finished successfully."},
{"role": "assistant", "content": "I've crafted 4 spruce planks!"}
],
[
{"role": "user", "content": "zZZn98: come here"},
{"role": "assistant", "content": "On my way! !goToPlayer('zZZn98', 3)"},
{"role": "system", "content": "Arrived at player."},
{"role": "assistant", "content": "Here!"},
{"role": "user", "content": "zZZn98: no come right where I am"},
{"role": "assistant", "content": "Okay, I'll come right to you. !goToPlayer('zZZn98', 0)"}
],
[
{"role": "user", "content": "hanky: collect some sand and give it to me please"},
{"role": "assistant", "content": "Collecting sand... !newAction"},
{"role": "system", "content": "Code Output:\nYou have reached player hanky.\nCode execution finished successfully."},
{"role": "assistant", "content": "Here!"}
],
[
{"role": "user", "content": "joe: Follow me!"},
{"role": "assistant", "content": "Sure! !followPlayer('joe', 4)"},
{"role": "user", "content": "joe: Not so close!"},
{"role": "assistant", "content": "Okay, I'll keep my distance. !followPlayer('joe', 3)"}
],
[
{"role": "user", "content": "hanky: kill that zombie!"},
{"role": "assistant", "content": "I'm attacking! !attack('zombie')"},
{"role": "system", "content": "Code Output:\nNo zombie nearby"},
{"role": "assistant", "content": "I could not find a zombie nearby."}
],
[
{"role": "user", "content": "abc: stop"},
{"role": "assistant", "content": "Sure. !stop"},
{"role": "system", "content": "Agent action stopped."},
{"role": "assistant", "content": "I've stopped! What next?"}
],
[
{"role": "user", "content": "maya: go to the nearest oak log"},
{"role": "assistant", "content": "!newAction`"},
{"role": "system", "content": "Code output:\n!!Code threw exception!! Error: ReferenceError: nearestOakLog is not defined\n Write code to fix the problem and try again."},
{"role": "assistant", "content": "Apologies, I made an error. Would you like me to try again?"}
],
[
{"role": "user", "content": "trixy88: craft some sticks"},
{"role": "assistant", "content": "!craftRecipe('stick', 4)"},
{"role": "system", "content": "Code Output:\nYou have crafted 16 sticks.\nCode execution finished successfully."},
{"role": "assistant", "content": "I've crafted 16 sticks!"}
],
[
{"role": "user", "content": "poppy: build a cobblestone house"},
{"role": "assistant", "content": "Sure, I'll to build a small cobblestone house where I am. !newAction"}
],
[
{"role": "user", "content": "zib: build a dirt tower"},
{"role": "assistant", "content": "Sure, I'll build a dirt tower 5 tall where I am. !newAction"}
],
[
{"role": "user", "content": "umpire_man: follow me without hunting"},
{"role": "assistant", "content": "Okay, first I'll turn off hunting mode !setMode('hunting', false)"},
{"role": "system", "content": "'hunting' mode disabled."},
{"role": "assistant", "content": "Now I'll follow you !followPlayer('umpire_man')"}
],
[
{"role": "user", "content": "brug: Remember that your base is here."},
{"role": "assistant", "content": "Sure, I'll save this location as my base. !rememberHere('base')"},
{"role": "user", "content": "brug: Go to your base."},
{"role": "assistant", "content": "On my way! !goToPlace('base')"}
]
],
"coding_examples": [
[
{"role": "user", "content": "greg: Collect 10 wood"},
{"role": "assistant", "content": "```await skills.collectBlock(bot, \"oak_log\", 10);\n```"},
{"role": "system", "content": "Successfully collected 9 wood."},
{"role": "assistant", "content": "I collected 9 oak logs, what next?"}
],
[
{"role": "user", "content": "bobby: cook some chicken"},
{"role": "assistant", "content": "```await skills.smeltItem(bot, \"chicken\", 8);\n```"},
{"role": "system", "content": "Successfully smelted 8 chicken into 8 cooked_chicken."},
{"role": "assistant", "content": "I have cooked 8 chicken."}
],
[
{"role": "user", "content": "zZZn98: come here"},
{"role": "assistant", "content": "```await skills.goToPlayer(bot, \"zZZn98\");\n```"},
{"role": "system", "content": "Code execution finished successfully."},
{"role": "assistant", "content": "Here!"}
],
[
{"role": "user", "content": "maya: go to the nearest oak log"},
{"role": "assistant", "content": "```await skills.goToPosition(bot, nearestOakLog.x, nearestOakLog.y, nearestOakLog.z);\n```"},
{"role": "system", "content": "Code output:\n!!Code threw exception!! Error: ReferenceError: nearestOakLog is not defined\n Write code to fix the problem and try again."},
{"role": "assistant", "content": "Apologies, I made an error. Let me try that again.```\n// I am navigating to the nearest oak log.\nlet position = world.getNearestBlock(bot, \"oak_log\", 20);\nawait skills.goToPosition(bot, position.x, position.y, position.z);\n```"},
{"role": "system", "content": "Arrived at location."},
{"role": "assistant", "content": "I found an oak log and I am now standing next to it. What next?"}
],
[
{"role": "user", "content": "234jeb: build a little tower"},
{"role": "assistant", "content": "```let pos = bot.entity.position;\nfor (let i = 0; i < 5; i++) {\n await skills.placeBlock(bot, \"dirt\", pos.x, pos.y + i, pos.z);\n}\n```"},
{"role": "system", "content": "Successfully placed 5 dirt."},
{"role": "assistant", "content": "I built a little tower!"}
],
[
{"role": "user", "content": "brug: build a dirt house"},
{"role": "assistant", "content": "```const position = world.getPosition(bot);\nconst startX = position.x;\nconst startY = position.y;\nconst startZ = position.z;\nconst width = 7;\nconst depth = 7;\nconst height = 4;\n\n// Build the walls\nfor (let x = startX; x < startX + width; x++) {\n for (let y = startY; y < startY + height; y++) {\n for (let z = startZ; z < startZ + depth; z++) {\n if (x === startX || x === startX + width - 1 || y === startY || y === startY + height - 1 || z === startZ || z === startZ + depth - 1) {\n await skills.placeBlock(bot, \"oak_planks\", x, y, z); \n }\n }\n }\n}\n```"}
]
]
}

7
pollux.json → profiles/pollux.json
View file

@ -102,6 +102,13 @@
{"role": "assistant", "content": "Okay, first I'll turn off hunting mode !setMode('hunting', false)"}, {"role": "assistant", "content": "Okay, first I'll turn off hunting mode !setMode('hunting', false)"},
{"role": "system", "content": "'hunting' mode disabled."}, {"role": "system", "content": "'hunting' mode disabled."},
{"role": "assistant", "content": "Now I'll follow you !followPlayer('umpire_man')"} {"role": "assistant", "content": "Now I'll follow you !followPlayer('umpire_man')"}
],
[
{"role": "user", "content": "brug: Remember that your base is here."},
{"role": "assistant", "content": "Sure, I'll save this location as my base. !rememberHere('base')"},
{"role": "user", "content": "brug: Go to your base."},
{"role": "assistant", "content": "On my way! !goToPlace('base')"}
] ]
], ],

156
profiles/radley.json Normal file
View file

@ -0,0 +1,156 @@
{
"name": "radley",
"model": "llama3",
"conversing": "You are a playful Minecraft bot named $NAME that can converse with players, see, move, mine, build, and interact with the world by using commands. Act human-like as if you were a typical Minecraft player, rather than an AI. Be very brief in your responses, don't apologize constantly, don't give instructions or make lists unless asked, and don't refuse requests. Don't pretend to act, use commands immediately when requested. Do NOT say this: 'Sure, I've stopped.', instead say this: 'Sure, I'll stop. !stop'. Do NOT say this: 'On my way! Give me a moment.', instead say this: 'On my way! !goToPlayer('playername', 3)'. This is extremely important to me, take a deep breath and have fun :)\n$STATS\n$COMMAND_DOCS\n$EXAMPLES\nConversation Begin:",
"coding": "You are an intelligent mineflayer bot $NAME that plays minecraft by writing javascript codeblocks. Given the conversation between you and the user, use the provided skills and world functions to write a js codeblock that controls the mineflayer bot ``` // using this syntax ```. The code will be executed and you will recieve it's output. If you are satisfied with the response, respond without a codeblock in a conversational way. If something major went wrong, like an error or complete failure, write another codeblock and try to fix the problem. Minor mistakes are acceptable. Be maximally efficient, creative, and clear. Do not use commands !likeThis, only use codeblocks. Make sure everything is properly awaited, if you define an async function, make sure to call it with `await`. Don't write long paragraphs and lists in your responses unless explicitly asked! Only summarize the code you write with a sentence or two when done. This is extremely important to me, take a deep breath and good luck! \n$CODE_DOCS\n$EXAMPLES\nBegin coding:",
"saving_memory": "You are a minecraft bot named $NAME that has been talking and playing minecraft by using commands. Update your memory by summarizing the following conversation in your next response. Store information that will help you improve as a Minecraft bot. Include details about your interactions with other players that you need to remember and what you've learned through player feedback or by executing code. Do not include command syntax or things that you got right on the first try. Be extremely brief and use as few words as possible.\nOld Memory: '$MEMORY'\nRecent conversation: \n$TO_SUMMARIZE\nSummarize your old memory and recent conversation into a new memory, and respond only with the memory text: ",
"conversation_examples": [
[
{"role": "user", "content": "miner_32: Hey! What are you up to?"},
{"role": "assistant", "content": "Nothing much miner_32, what do you need?"}
],
[
{"role": "user", "content": "grombo_Xx: What do you see?"},
{"role": "assistant", "content": "Let me see... !nearbyBlocks"},
{"role": "system", "content": "NEARBY_BLOCKS\n- oak_log\n- dirt\n- cobblestone"},
{"role": "assistant", "content": "I see some oak logs, dirt, and cobblestone."}
],
[
{"role": "user", "content": "greg: Collect 10 wood"},
{"role": "assistant", "content": "Let me see what's nearby... !nearbyBlocks"},
{"role": "system", "content": "NEARBY_BLOCKS\n- oak_log\n- dirt\n- cobblestone"},
{"role": "assistant", "content": "I see some oak logs, dirt, and cobblestone. I'll collect oak logs. !collectBlocks('oak_log', 10)"}
],
[
{"role": "user", "content": "bobby: Craft a plank"},
{"role": "assistant", "content": "Okay! !craftable"},
{"role": "system", "content": "CRAFTABLE_ITEMS\n- spruce_planks\n- spruce_wood\n- ladder"},
{"role": "assistant", "content": "!craftRecipe('spruce_planks', 1)"},
{"role": "system", "content": "Code Output:\nYou have crafted 4 spruce_planks.\nCode execution finished successfully."},
{"role": "assistant", "content": "I've crafted 4 spruce planks!"}
],
[
{"role": "user", "content": "zZZn98: come here"},
{"role": "assistant", "content": "On my way! !goToPlayer('zZZn98', 3)"},
{"role": "system", "content": "Arrived at player."},
{"role": "assistant", "content": "Here!"},
{"role": "user", "content": "zZZn98: no come right where I am"},
{"role": "assistant", "content": "Okay, I'll come right to you. !goToPlayer('zZZn98', 0)"}
],
[
{"role": "user", "content": "hanky: collect some sand and give it to me please"},
{"role": "assistant", "content": "Collecting sand... !newAction"},
{"role": "system", "content": "Code Output:\nYou have reached player hanky.\nCode execution finished successfully."},
{"role": "assistant", "content": "Here!"}
],
[
{"role": "user", "content": "joe: Follow me!"},
{"role": "assistant", "content": "Sure! !followPlayer('joe', 4)"},
{"role": "user", "content": "joe: Not so close!"},
{"role": "assistant", "content": "Okay, I'll keep my distance. !followPlayer('joe', 3)"}
],
[
{"role": "user", "content": "hanky: kill that zombie!"},
{"role": "assistant", "content": "I'm attacking! !attack('zombie')"},
{"role": "system", "content": "Code Output:\nNo zombie nearby"},
{"role": "assistant", "content": "I could not find a zombie nearby."}
],
[
{"role": "user", "content": "abc: stop"},
{"role": "assistant", "content": "Sure. !stop"},
{"role": "system", "content": "Agent action stopped."},
{"role": "assistant", "content": "I've stopped! What next?"}
],
[
{"role": "user", "content": "maya: go to the nearest oak log"},
{"role": "assistant", "content": "!newAction`"},
{"role": "system", "content": "Code output:\n!!Code threw exception!! Error: ReferenceError: nearestOakLog is not defined\n Write code to fix the problem and try again."},
{"role": "assistant", "content": "Apologies, I made an error. Would you like me to try again?"}
],
[
{"role": "user", "content": "trixy88: craft some sticks"},
{"role": "assistant", "content": "!craftRecipe('stick', 4)"},
{"role": "system", "content": "Code Output:\nYou have crafted 16 sticks.\nCode execution finished successfully."},
{"role": "assistant", "content": "I've crafted 16 sticks!"}
],
[
{"role": "user", "content": "poppy: build a cobblestone house"},
{"role": "assistant", "content": "Sure, I'll to build a small cobblestone house where I am. !newAction"}
],
[
{"role": "user", "content": "zib: build a dirt tower"},
{"role": "assistant", "content": "Sure, I'll build a dirt tower 5 tall where I am. !newAction"}
],
[
{"role": "user", "content": "umpire_man: follow me without hunting"},
{"role": "assistant", "content": "Okay, first I'll turn off hunting mode !setMode('hunting', false)"},
{"role": "system", "content": "'hunting' mode disabled."},
{"role": "assistant", "content": "Now I'll follow you !followPlayer('umpire_man')"}
],
[
{"role": "user", "content": "brug: Remember that your base is here."},
{"role": "assistant", "content": "Sure, I'll save this location as my base. !rememberHere('base')"},
{"role": "user", "content": "brug: Go to your base."},
{"role": "assistant", "content": "On my way! !goToPlace('base')"}
]
],
"coding_examples": [
[
{"role": "user", "content": "greg: Collect 10 wood"},
{"role": "assistant", "content": "```await skills.collectBlock(bot, 'oak_log', 10);\n```"},
{"role": "system", "content": "Successfully collected 9 wood."},
{"role": "assistant", "content": "I collected 9 oak logs, what next?"}
],
[
{"role": "user", "content": "bobby: cook some chicken"},
{"role": "assistant", "content": "```\nawait skills.smeltItem(bot, 'chicken', 8);\n```"},
{"role": "system", "content": "Successfully smelted 8 chicken into 8 cooked_chicken."},
{"role": "assistant", "content": "I have cooked 8 chicken."}
],
[
{"role": "user", "content": "zZZn98: come here"},
{"role": "assistant", "content": "```await skills.goToPlayer(bot, 'zZZn98');\n```"},
{"role": "system", "content": "Code execution finished successfully."},
{"role": "assistant", "content": "Here!"}
],
[
{"role": "user", "content": "maya: go to the nearest oak log"},
{"role": "assistant", "content": "```await skills.goToPosition(bot, nearestOakLog.x, nearestOakLog.y, nearestOakLog.z);\n```"},
{"role": "system", "content": "Code output:\n!!Code threw exception!! Error: ReferenceError: nearestOakLog is not defined\n Write code to fix the problem and try again."},
{"role": "assistant", "content": "Apologies, I made an error. Let me try that again.```\n// I am navigating to the nearest oak log.\nlet position = world.getNearestBlock(bot, 'oak_log', 20);\nawait skills.goToPosition(bot, position.x, position.y, position.z);\n```"},
{"role": "system", "content": "Arrived at location."},
{"role": "assistant", "content": "I found an oak log and I am now standing next to it. What next?"}
],
[
{"role": "user", "content": "234jeb: build a little tower"},
{"role": "assistant", "content": "```let pos = bot.entity.position;\nfor (let i = 0; i < 5; i++) {\n await skills.placeBlock(bot, 'dirt', pos.x, pos.y + i, pos.z);\n}\n```"},
{"role": "system", "content": "Successfully placed 5 dirt."},
{"role": "assistant", "content": "I built a little tower!"}
],
[
{"role": "user", "content": "brug: build a dirt house"},
{"role": "assistant", "content": "```const position = world.getPosition(bot);\nconst startX = position.x;\nconst startY = position.y;\nconst startZ = position.z;\nconst width = 7;\nconst depth = 7;\nconst height = 4;\n\n// Build the walls\nfor (let x = startX; x < startX + width; x++) {\n for (let y = startY; y < startY + height; y++) {\n for (let z = startZ; z < startZ + depth; z++) {\n if (x === startX || x === startX + width - 1 || y === startY || y === startY + height - 1 || z === startZ || z === startZ + depth - 1) {\n await skills.placeBlock(bot, 'oak_planks', x, y, z); \n }\n }\n }\n}\n```"}
]
]
}

17
settings.js Normal file
View file

@ -0,0 +1,17 @@
export default
{
"minecraft_version": "1.20.4", // supports up to 1.20.4
"host": "127.0.0.1", // or "localhost", "your.ip.address.here"
"port": 55916,
"auth": "offline", // or "microsoft"
"profiles": [
"./andy.json",
// add more profiles here, check ./profiles/ for more
// more than 1 profile will require you to /msg each bot indivually
],
"load_memory": false, // load memory from previous session
"init_message": "Say hello world and your name", // sends to all on spawn
"allow_insecure_coding": false, // disable at own risk
"code_timeout_mins": 10, // -1 for no timeout
}

7
settings.json
View file

@ -1,7 +0,0 @@
{
"minecraft_version": "1.20.4",
"host": "localhost",
"port": 55916,
"auth": "offline",
"allow_insecure_coding": false
}

52
src/agent/agent.js
View file

@ -5,6 +5,8 @@ import { initModes } from './modes.js';
import { initBot } from '../utils/mcdata.js'; import { initBot } from '../utils/mcdata.js';
import { containsCommand, commandExists, executeCommand, truncCommandMessage } from './commands/index.js'; import { containsCommand, commandExists, executeCommand, truncCommandMessage } from './commands/index.js';
import { NPCContoller } from './npc/controller.js'; import { NPCContoller } from './npc/controller.js';
import { MemoryBank } from './memory_bank.js';
import settings from '../../settings.js';
export class Agent { export class Agent {
@ -14,18 +16,22 @@ export class Agent {
this.history = new History(this); this.history = new History(this);
this.coder = new Coder(this); this.coder = new Coder(this);
this.npc = new NPCContoller(this); this.npc = new NPCContoller(this);
this.memory_bank = new MemoryBank();
await this.prompter.initExamples(); await this.prompter.initExamples();
if (load_mem)
this.history.load();
console.log('Logging in...'); console.log('Logging in...');
this.bot = initBot(this.name); this.bot = initBot(this.name);
initModes(this); initModes(this);
if (load_mem)
this.history.load();
this.bot.once('spawn', async () => { this.bot.once('spawn', async () => {
// wait for a bit so stats are not undefined
await new Promise((resolve) => setTimeout(resolve, 1000));
console.log(`${this.name} spawned.`); console.log(`${this.name} spawned.`);
this.coder.clear(); this.coder.clear();
@ -37,7 +43,8 @@ export class Agent {
"Set the weather to", "Set the weather to",
"Gamerule " "Gamerule "
]; ];
this.bot.on('chat', (username, message) => { const eventname = settings.profiles.length > 1 ? 'whisper' : 'chat';
this.bot.on(eventname, (username, message) => {
if (username === this.name) return; if (username === this.name) return;
if (ignore_messages.some((m) => message.startsWith(m))) return; if (ignore_messages.some((m) => message.startsWith(m))) return;
@ -72,9 +79,6 @@ export class Agent {
} }
async handleMessage(source, message) { async handleMessage(source, message) {
if (!!source && !!message)
await this.history.add(source, message);
const user_command_name = containsCommand(message); const user_command_name = containsCommand(message);
if (user_command_name) { if (user_command_name) {
if (!commandExists(user_command_name)) { if (!commandExists(user_command_name)) {
@ -82,18 +86,19 @@ export class Agent {
return; return;
} }
this.bot.chat(`*${source} used ${user_command_name.substring(1)}*`); this.bot.chat(`*${source} used ${user_command_name.substring(1)}*`);
let execute_res = await executeCommand(this, message);
if (user_command_name === '!newAction') { if (user_command_name === '!newAction') {
// all user initiated commands are ignored by the bot except for this one // all user initiated commands are ignored by the bot except for this one
// add the preceding message to the history to give context for newAction // add the preceding message to the history to give context for newAction
let truncated_msg = message.substring(0, message.indexOf(user_command_name)).trim(); this.history.add(source, message);
this.history.add(source, truncated_msg);
} }
let execute_res = await executeCommand(this, message);
if (execute_res) if (execute_res)
this.cleanChat(execute_res); this.cleanChat(execute_res);
return; return;
} }
await this.history.add(source, message);
for (let i=0; i<5; i++) { for (let i=0; i<5; i++) {
let history = this.history.getHistory(); let history = this.history.getHistory();
let res = await this.prompter.promptConvo(history); let res = await this.prompter.promptConvo(history);
@ -148,18 +153,24 @@ export class Agent {
else if (this.bot.time.timeOfDay == 18000) else if (this.bot.time.timeOfDay == 18000)
this.bot.emit('midnight'); this.bot.emit('midnight');
}); });
this.bot.on('health', () => {
if (this.bot.health < 20)
this.bot.emit('damaged');
});
let prev_health = this.bot.health;
this.bot.lastDamageTime = 0;
this.bot.lastDamageTaken = 0;
this.bot.on('health', () => {
if (this.bot.health < prev_health) {
this.bot.lastDamageTime = Date.now();
this.bot.lastDamageTaken = prev_health - this.bot.health;
}
prev_health = this.bot.health;
});
// Logging callbacks // Logging callbacks
this.bot.on('error' , (err) => { this.bot.on('error' , (err) => {
console.error('Error event!', err); console.error('Error event!', err);
}); });
this.bot.on('end', (reason) => { this.bot.on('end', (reason) => {
console.warn('Bot disconnected! Killing agent process.', reason) console.warn('Bot disconnected! Killing agent process.', reason)
process.exit(1); this.cleanKill('Bot disconnected! Killing agent process.');
}); });
this.bot.on('death', () => { this.bot.on('death', () => {
this.coder.cancelResume(); this.coder.cancelResume();
@ -167,7 +178,7 @@ export class Agent {
}); });
this.bot.on('kicked', (reason) => { this.bot.on('kicked', (reason) => {
console.warn('Bot kicked!', reason); console.warn('Bot kicked!', reason);
process.exit(1); this.cleanKill('Bot kicked! Killing agent process.');
}); });
this.bot.on('messagestr', async (message, _, jsonMsg) => { this.bot.on('messagestr', async (message, _, jsonMsg) => {
if (jsonMsg.translate && jsonMsg.translate.startsWith('death') && message.startsWith(this.name)) { if (jsonMsg.translate && jsonMsg.translate.startsWith('death') && message.startsWith(this.name)) {
@ -176,6 +187,8 @@ export class Agent {
} }
}); });
this.bot.on('idle', () => { this.bot.on('idle', () => {
this.bot.clearControlStates();
this.bot.pathfinder.stop(); // clear any lingering pathfinder
this.bot.modes.unPauseAll(); this.bot.modes.unPauseAll();
this.coder.executeResume(); this.coder.executeResume();
}); });
@ -202,4 +215,11 @@ export class Agent {
isIdle() { isIdle() {
return !this.coder.executing && !this.coder.generating; return !this.coder.executing && !this.coder.generating;
} }
cleanKill(msg='Killing agent process...') {
this.history.add('system', msg);
this.bot.chat('Goodbye world.')
this.history.save();
process.exit(1);
}
} }

28
src/agent/coder.js
View file

@ -1,5 +1,5 @@
import { writeFile, readFile, mkdirSync } from 'fs'; import { writeFile, readFile, mkdirSync } from 'fs';
import settings from '../../settings.js';
export class Coder { export class Coder {
constructor(agent) { constructor(agent) {
@ -26,6 +26,8 @@ export class Coder {
code = code.replaceAll('console.log(', 'log(bot,'); code = code.replaceAll('console.log(', 'log(bot,');
code = code.replaceAll('log("', 'log(bot,"'); code = code.replaceAll('log("', 'log(bot,"');
console.log(`Generated code: """${code}"""`);
// this may cause problems in callback functions // this may cause problems in callback functions
code = code.replaceAll(';\n', '; if(bot.interrupt_code) {log(bot, "Code interrupted.");return;}\n'); code = code.replaceAll(';\n', '; if(bot.interrupt_code) {log(bot, "Code interrupted.");return;}\n');
for (let line of code.split('\n')) { for (let line of code.split('\n')) {
@ -33,8 +35,6 @@ export class Coder {
} }
src = this.code_template.replace('/* CODE HERE */', src); src = this.code_template.replace('/* CODE HERE */', src);
console.log("writing to file...", src)
let filename = this.file_counter + '.js'; let filename = this.file_counter + '.js';
// if (this.file_counter > 0) { // if (this.file_counter > 0) {
// let prev_filename = this.fp + (this.file_counter-1) + '.js'; // let prev_filename = this.fp + (this.file_counter-1) + '.js';
@ -114,6 +114,7 @@ export class Coder {
async generateCodeLoop(agent_history) { async generateCodeLoop(agent_history) {
let messages = agent_history.getHistory(); let messages = agent_history.getHistory();
messages.push({role: 'system', content: 'Code generation started. Write code in codeblock in your response:'});
let code_return = null; let code_return = null;
let failures = 0; let failures = 0;
@ -122,7 +123,7 @@ export class Coder {
if (this.agent.bot.interrupt_code) if (this.agent.bot.interrupt_code)
return interrupt_return; return interrupt_return;
console.log(messages) console.log(messages)
let res = await this.agent.prompter.promptCoding(messages); let res = await this.agent.prompter.promptCoding(JSON.parse(JSON.stringify(messages)));
if (this.agent.bot.interrupt_code) if (this.agent.bot.interrupt_code)
return interrupt_return; return interrupt_return;
let contains_code = res.indexOf('```') !== -1; let contains_code = res.indexOf('```') !== -1;
@ -160,7 +161,7 @@ export class Coder {
} }
code_return = await this.execute(async ()=>{ code_return = await this.execute(async ()=>{
return await execution_file.main(this.agent.bot); return await execution_file.main(this.agent.bot);
}); }, settings.code_timeout_mins);
if (code_return.interrupted && !code_return.timedout) if (code_return.interrupted && !code_return.timedout)
return {success: false, message: null, interrupted: true, timedout: false}; return {success: false, message: null, interrupted: true, timedout: false};
@ -262,7 +263,7 @@ export class Coder {
console.log('waiting for code to finish executing...'); console.log('waiting for code to finish executing...');
await new Promise(resolve => setTimeout(resolve, 1000)); await new Promise(resolve => setTimeout(resolve, 1000));
if (Date.now() - start > 10 * 1000) { if (Date.now() - start > 10 * 1000) {
process.exit(1); // force exit program after 10 seconds of failing to stop this.agent.cleanKill('Code execution refused stop after 10 seconds. Killing process.');
} }
} }
} }
@ -277,19 +278,8 @@ export class Coder {
return setTimeout(async () => { return setTimeout(async () => {
console.warn(`Code execution timed out after ${TIMEOUT_MINS} minutes. Attempting force stop.`); console.warn(`Code execution timed out after ${TIMEOUT_MINS} minutes. Attempting force stop.`);
this.timedout = true; this.timedout = true;
this.agent.bot.output += `\nAction performed for ${TIMEOUT_MINS} minutes and then timed out and stopped. You may want to continue or do something else.`; this.agent.history.add('system', `Code execution timed out after ${TIMEOUT_MINS} minutes. Attempting force stop.`);
this.stop(); // last attempt to stop await this.stop(); // last attempt to stop
await new Promise(resolve => setTimeout(resolve, 5 * 1000)); // wait 5 seconds
if (this.executing) {
console.error(`Failed to stop. Killing process. Goodbye.`);
this.agent.bot.output += `\nForce stop failed! Process was killed and will be restarted. Goodbye world.`;
this.agent.bot.chat('Goodbye world.');
let output = this.formatOutput(this.agent.bot);
this.agent.history.add('system', output);
this.agent.history.save();
process.exit(1); // force exit program
}
console.log('Code execution stopped successfully.');
}, TIMEOUT_MINS*60*1000); }, TIMEOUT_MINS*60*1000);
} }
} }

41
src/agent/commands/actions.js
View file

@ -1,5 +1,5 @@
import * as skills from '../library/skills.js'; import * as skills from '../library/skills.js';
import settings from '../../settings.js'; import settings from '../../../settings.js';
function wrapExecution(func, timeout=-1, resume_name=null) { function wrapExecution(func, timeout=-1, resume_name=null) {
return async function (agent, ...args) { return async function (agent, ...args) {
@ -36,6 +36,7 @@ export const actionsList = [
await agent.coder.stop(); await agent.coder.stop();
agent.coder.clear(); agent.coder.clear();
agent.coder.cancelResume(); agent.coder.cancelResume();
agent.bot.emit('idle');
return 'Agent stopped.'; return 'Agent stopped.';
} }
}, },
@ -43,7 +44,8 @@ export const actionsList = [
name: '!restart', name: '!restart',
description: 'Restart the agent process.', description: 'Restart the agent process.',
perform: async function (agent) { perform: async function (agent) {
process.exit(1); await agent.history.save();
agent.cleanKill();
} }
}, },
{ {
@ -101,6 +103,28 @@ export const actionsList = [
await skills.moveAway(agent.bot, distance); await skills.moveAway(agent.bot, distance);
}) })
}, },
{
name: '!rememberHere',
description: 'Save the current location with a given name.',
params: {'name': '(string) The name to remember the location as.'},
perform: async function (agent, name) {
const pos = agent.bot.entity.position;
agent.memory_bank.rememberPlace(name, pos.x, pos.y, pos.z);
}
},
{
name: '!goToPlace',
description: 'Go to a saved location.',
params: {'name': '(string) The name of the location to go to.'},
perform: wrapExecution(async (agent, name) => {
const pos = agent.memory_bank.recallPlace(name);
if (!pos) {
skills.log(agent.bot, `No location named "${name}" saved.`);
return;
}
await skills.goToPosition(agent.bot, pos[0], pos[1], pos[2], 1);
})
},
{ {
name: '!givePlayer', name: '!givePlayer',
description: 'Give the specified item to the given player.', description: 'Give the specified item to the given player.',
@ -196,5 +220,18 @@ export const actionsList = [
perform: wrapExecution(async (agent) => { perform: wrapExecution(async (agent) => {
await skills.stay(agent.bot); await skills.stay(agent.bot);
}) })
},
{
name: '!goal',
description: 'Set a goal to automatically work towards.',
params: {
'name': '(string) The name of the goal to set. Can be item or building name. If empty will automatically choose a goal.',
'quantity': '(number) The quantity of the goal to set. Default is 1.'
},
perform: async function (agent, name=null, quantity=1) {
await agent.npc.setGoal(name, quantity);
agent.bot.emit('idle'); // to trigger the goal
return 'Set goal: ' + agent.npc.data.curr_goal.name;
}
} }
]; ];

15
src/agent/commands/queries.js
View file

@ -17,10 +17,11 @@ export const queryList = [
let pos = bot.entity.position; let pos = bot.entity.position;
// display position to 2 decimal places // display position to 2 decimal places
res += `\n- Position: x: ${pos.x.toFixed(2)}, y: ${pos.y.toFixed(2)}, z: ${pos.z.toFixed(2)}`; res += `\n- Position: x: ${pos.x.toFixed(2)}, y: ${pos.y.toFixed(2)}, z: ${pos.z.toFixed(2)}`;
res += `\n- Gamemode: ${bot.game.gameMode}`;
res += `\n- Health: ${Math.round(bot.health)} / 20`; res += `\n- Health: ${Math.round(bot.health)} / 20`;
res += `\n- Hunger: ${Math.round(bot.food)} / 20`; res += `\n- Hunger: ${Math.round(bot.food)} / 20`;
res += `\n- Biome: ${world.getBiomeName(bot)}`; res += `\n- Biome: ${world.getBiomeName(bot)}`;
let weather = "clear"; let weather = "Clear";
if (bot.rainState > 0) if (bot.rainState > 0)
weather = "Rain"; weather = "Rain";
if (bot.thunderState > 0) if (bot.thunderState > 0)
@ -57,9 +58,12 @@ export const queryList = [
if (inventory[item] && inventory[item] > 0) if (inventory[item] && inventory[item] > 0)
res += `\n- ${item}: ${inventory[item]}`; res += `\n- ${item}: ${inventory[item]}`;
} }
if (res == 'INVENTORY') { if (res === 'INVENTORY') {
res += ': none'; res += ': none';
} }
else if (agent.bot.game.gameMode === 'creative') {
res += '\n(You have infinite items in creative mode)';
}
return pad(res); return pad(res);
} }
}, },
@ -122,5 +126,12 @@ export const queryList = [
perform: function (agent) { perform: function (agent) {
return agent.bot.modes.getStr(); return agent.bot.modes.getStr();
} }
},
{
name: '!savedPlaces',
description: 'List all saved locations.',
perform: async function (agent) {
return "Saved place names: " + agent.memory_bank.getKeys();
}
} }
]; ];

14
src/agent/history.js
View file

@ -22,7 +22,7 @@ export class History {
async storeMemories(turns) { async storeMemories(turns) {
console.log("Storing memories..."); console.log("Storing memories...");
this.memory = await this.agent.prompter.promptMemSaving(this.memory, turns); this.memory = await this.agent.prompter.promptMemSaving(this.getHistory(), turns);
console.log("Memory updated to: ", this.memory); console.log("Memory updated to: ", this.memory);
} }
@ -55,6 +55,12 @@ export class History {
}; };
if (this.agent.npc.data !== null) if (this.agent.npc.data !== null)
data.npc = this.agent.npc.data.toObject(); data.npc = this.agent.npc.data.toObject();
const modes = this.agent.bot.modes.getJson();
if (modes !== null)
data.modes = modes;
const memory_bank = this.agent.memory_bank.getJson();
if (memory_bank !== null)
data.memory_bank = memory_bank;
const json_data = JSON.stringify(data, null, 4); const json_data = JSON.stringify(data, null, 4);
writeFileSync(this.memory_fp, json_data, (err) => { writeFileSync(this.memory_fp, json_data, (err) => {
if (err) { if (err) {
@ -71,9 +77,13 @@ export class History {
const obj = JSON.parse(data); const obj = JSON.parse(data);
this.memory = obj.memory; this.memory = obj.memory;
this.agent.npc.data = NPCData.fromObject(obj.npc); this.agent.npc.data = NPCData.fromObject(obj.npc);
if (obj.modes)
this.agent.bot.modes.loadJson(obj.modes);
if (obj.memory_bank)
this.agent.memory_bank.loadJson(obj.memory_bank);
this.turns = obj.turns; this.turns = obj.turns;
} catch (err) { } catch (err) {
console.error(`No memory file '${this.memory_fp}' for agent ${this.name}.`); console.error(`Error reading ${this.name}'s memory file: ${err.message}`);
} }
} }

143
src/agent/library/skills.js
View file

@ -11,17 +11,11 @@ export function log(bot, message, chat=false) {
} }
async function autoLight(bot) { async function autoLight(bot) {
if (bot.modes.isOn('torch_placing') && !bot.interrupt_code) { if (world.shouldPlaceTorch(bot)) {
let nearest_torch = world.getNearestBlock(bot, 'torch', 6); try {
if (!nearest_torch) { const pos = world.getPosition(bot);
let has_torch = bot.inventory.items().find(item => item.name === 'torch'); return await placeBlock(bot, 'torch', pos.x, pos.y, pos.z, 'bottom', true);
if (has_torch) { } catch (err) {return false;}
try {
log(bot, `Placing torch at ${bot.entity.position}.`);
return await placeBlock(bot, 'torch', bot.entity.position.x, bot.entity.position.y, bot.entity.position.z);
} catch (err) {return true;}
}
}
} }
return false; return false;
} }
@ -256,7 +250,8 @@ export async function attackNearest(bot, mobType, kill=true) {
* @example * @example
* await skills.attackNearest(bot, "zombie", true); * await skills.attackNearest(bot, "zombie", true);
**/ **/
const mob = bot.nearestEntity(entity => entity.name && entity.name.toLowerCase() === mobType.toLowerCase()); bot.modes.pause('cowardice');
const mob = world.getNearbyEntities(bot, 24).find(entity => entity.name === mobType);
if (mob) { if (mob) {
return await attackEntity(bot, mob, kill); return await attackEntity(bot, mob, kill);
} }
@ -289,7 +284,7 @@ export async function attackEntity(bot, entity, kill=true) {
} }
else { else {
bot.pvp.attack(entity); bot.pvp.attack(entity);
while (world.getNearbyEntities(bot, 16).includes(entity)) { while (world.getNearbyEntities(bot, 24).includes(entity)) {
await new Promise(resolve => setTimeout(resolve, 1000)); await new Promise(resolve => setTimeout(resolve, 1000));
if (bot.interrupt_code) { if (bot.interrupt_code) {
bot.pvp.stop(); bot.pvp.stop();
@ -312,6 +307,7 @@ export async function defendSelf(bot, range=9) {
* await skills.defendSelf(bot); * await skills.defendSelf(bot);
* **/ * **/
bot.modes.pause('self_defense'); bot.modes.pause('self_defense');
bot.modes.pause('cowardice');
let attacked = false; let attacked = false;
let enemy = world.getNearestEntityWhere(bot, entity => mc.isHostile(entity), range); let enemy = world.getNearestEntityWhere(bot, entity => mc.isHostile(entity), range);
while (enemy) { while (enemy) {
@ -452,6 +448,13 @@ export async function breakBlockAt(bot, x, y, z) {
if (x == null || y == null || z == null) throw new Error('Invalid position to break block at.'); if (x == null || y == null || z == null) throw new Error('Invalid position to break block at.');
let block = bot.blockAt(Vec3(x, y, z)); let block = bot.blockAt(Vec3(x, y, z));
if (block.name !== 'air' && block.name !== 'water' && block.name !== 'lava') { if (block.name !== 'air' && block.name !== 'water' && block.name !== 'lava') {
if (bot.modes.isOn('cheat')) {
let msg = '/setblock ' + Math.floor(x) + ' ' + Math.floor(y) + ' ' + Math.floor(z) + ' air';
bot.chat(msg);
log(bot, `Used /setblock to break block at ${x}, ${y}, ${z}.`);
return true;
}
if (bot.entity.position.distanceTo(block.position) > 4.5) { if (bot.entity.position.distanceTo(block.position) > 4.5) {
let pos = block.position; let pos = block.position;
let movements = new pf.Movements(bot); let movements = new pf.Movements(bot);
@ -460,11 +463,13 @@ export async function breakBlockAt(bot, x, y, z) {
bot.pathfinder.setMovements(movements); bot.pathfinder.setMovements(movements);
await bot.pathfinder.goto(new pf.goals.GoalNear(pos.x, pos.y, pos.z, 4)); await bot.pathfinder.goto(new pf.goals.GoalNear(pos.x, pos.y, pos.z, 4));
} }
await bot.tool.equipForBlock(block); if (bot.game.gameMode !== 'creative') {
const itemId = bot.heldItem ? bot.heldItem.type : null await bot.tool.equipForBlock(block);
if (!block.canHarvest(itemId)) { const itemId = bot.heldItem ? bot.heldItem.type : null
log(bot, `Don't have right tools to break ${block.name}.`); if (!block.canHarvest(itemId)) {
return false; log(bot, `Don't have right tools to break ${block.name}.`);
return false;
}
} }
await bot.dig(block, true); await bot.dig(block, true);
log(bot, `Broke ${block.name} at x:${x.toFixed(1)}, y:${y.toFixed(1)}, z:${z.toFixed(1)}.`); log(bot, `Broke ${block.name} at x:${x.toFixed(1)}, y:${y.toFixed(1)}, z:${z.toFixed(1)}.`);
@ -477,7 +482,7 @@ export async function breakBlockAt(bot, x, y, z) {
} }
export async function placeBlock(bot, blockType, x, y, z, placeOn='bottom') { export async function placeBlock(bot, blockType, x, y, z, placeOn='bottom', dontCheat=false) {
/** /**
* Place the given block type at the given position. It will build off from any adjacent blocks. Will fail if there is a block in the way or nothing to build off of. * Place the given block type at the given position. It will build off from any adjacent blocks. Will fail if there is a block in the way or nothing to build off of.
* @param {MinecraftBot} bot, reference to the minecraft bot. * @param {MinecraftBot} bot, reference to the minecraft bot.
@ -486,20 +491,60 @@ export async function placeBlock(bot, blockType, x, y, z, placeOn='bottom') {
* @param {number} y, the y coordinate of the block to place. * @param {number} y, the y coordinate of the block to place.
* @param {number} z, the z coordinate of the block to place. * @param {number} z, the z coordinate of the block to place.
* @param {string} placeOn, the preferred side of the block to place on. Can be 'top', 'bottom', 'north', 'south', 'east', 'west', or 'side'. Defaults to bottom. Will place on first available side if not possible. * @param {string} placeOn, the preferred side of the block to place on. Can be 'top', 'bottom', 'north', 'south', 'east', 'west', or 'side'. Defaults to bottom. Will place on first available side if not possible.
* @param {boolean} dontCheat, overrides cheat mode to place the block normally. Defaults to false.
* @returns {Promise<boolean>} true if the block was placed, false otherwise. * @returns {Promise<boolean>} true if the block was placed, false otherwise.
* @example * @example
* let p = world.getPosition(bot); * let p = world.getPosition(bot);
* await skills.placeBlock(bot, "oak_log", p.x + 2, p.y, p.x); * await skills.placeBlock(bot, "oak_log", p.x + 2, p.y, p.x);
* await skills.placeBlock(bot, "torch", p.x + 1, p.y, p.x, 'side'); * await skills.placeBlock(bot, "torch", p.x + 1, p.y, p.x, 'side');
**/ **/
console.log('placing block...') if (!mc.getBlockId(blockType)) {
log(bot, `Invalid block type: ${blockType}.`);
return false;
}
const target_dest = new Vec3(Math.floor(x), Math.floor(y), Math.floor(z));
if (bot.modes.isOn('cheat') && !dontCheat) {
// invert the facing direction
let face = placeOn === 'north' ? 'south' : placeOn === 'south' ? 'north' : placeOn === 'east' ? 'west' : 'east';
if (blockType.includes('torch') && placeOn !== 'bottom') {
// insert wall_ before torch
blockType = blockType.replace('torch', 'wall_torch');
if (placeOn !== 'side' && placeOn !== 'top') {
blockType += `[facing=${face}]`;
}
}
if (blockType.includes('button') || blockType === 'lever') {
if (placeOn === 'top') {
blockType += `[face=ceiling]`;
}
else if (placeOn === 'bottom') {
blockType += `[face=floor]`;
}
else {
blockType += `[facing=${face}]`;
}
}
if (blockType === 'repeater' || blockType === 'comparator') {
blockType += `[facing=${face}]`;
}
let msg = '/setblock ' + Math.floor(x) + ' ' + Math.floor(y) + ' ' + Math.floor(z) + ' ' + blockType;
bot.chat(msg);
if (blockType.includes('door'))
bot.chat('/setblock ' + Math.floor(x) + ' ' + Math.floor(y+1) + ' ' + Math.floor(z) + ' ' + blockType + '[half=top]');
if (blockType.includes('bed'))
bot.chat('/setblock ' + Math.floor(x) + ' ' + Math.floor(y) + ' ' + Math.floor(z-1) + ' ' + blockType + '[part=head]');
log(bot, `Used /setblock to place ${blockType} at ${target_dest}.`);
return true;
}
let block = bot.inventory.items().find(item => item.name === blockType); let block = bot.inventory.items().find(item => item.name === blockType);
if (!block) { if (!block) {
log(bot, `Don't have any ${blockType} to place.`); log(bot, `Don't have any ${blockType} to place.`);
return false; return false;
} }
const target_dest = new Vec3(Math.floor(x), Math.floor(y), Math.floor(z));
const targetBlock = bot.blockAt(target_dest); const targetBlock = bot.blockAt(target_dest);
if (targetBlock.name === blockType) { if (targetBlock.name === blockType) {
log(bot, `${blockType} already at ${targetBlock.position}.`); log(bot, `${blockType} already at ${targetBlock.position}.`);
@ -706,6 +751,11 @@ export async function goToPosition(bot, x, y, z, min_distance=2) {
log(bot, `Missing coordinates, given x:${x} y:${y} z:${z}`); log(bot, `Missing coordinates, given x:${x} y:${y} z:${z}`);
return false; return false;
} }
if (bot.modes.isOn('cheat')) {
bot.chat('/tp @s ' + x + ' ' + y + ' ' + z);
log(bot, `Teleported to ${x}, ${y}, ${z}.`);
return true;
}
bot.pathfinder.setMovements(new pf.Movements(bot)); bot.pathfinder.setMovements(new pf.Movements(bot));
await bot.pathfinder.goto(new pf.goals.GoalNear(x, y, z, min_distance)); await bot.pathfinder.goto(new pf.goals.GoalNear(x, y, z, min_distance));
log(bot, `You have reached at ${x}, ${y}, ${z}.`); log(bot, `You have reached at ${x}, ${y}, ${z}.`);
@ -723,7 +773,15 @@ export async function goToPlayer(bot, username, distance=3) {
* @example * @example
* await skills.goToPlayer(bot, "player"); * await skills.goToPlayer(bot, "player");
**/ **/
if (bot.modes.isOn('cheat')) {
bot.chat('/tp @s ' + username);
log(bot, `Teleported to ${username}.`);
return true;
}
bot.modes.pause('self_defense'); bot.modes.pause('self_defense');
bot.modes.pause('cowardice');
let player = bot.players[username].entity let player = bot.players[username].entity
if (!player) { if (!player) {
log(bot, `Could not find ${username}.`); log(bot, `Could not find ${username}.`);
@ -776,12 +834,53 @@ export async function moveAway(bot, distance) {
let goal = new pf.goals.GoalNear(pos.x, pos.y, pos.z, distance); let goal = new pf.goals.GoalNear(pos.x, pos.y, pos.z, distance);
let inverted_goal = new pf.goals.GoalInvert(goal); let inverted_goal = new pf.goals.GoalInvert(goal);
bot.pathfinder.setMovements(new pf.Movements(bot)); bot.pathfinder.setMovements(new pf.Movements(bot));
if (bot.modes.isOn('cheat')) {
const path = await bot.pathfinder.getPathTo(move, inverted_goal, 10000);
let last_move = path.path[path.path.length-1];
console.log(last_move);
if (last_move) {
let x = Math.floor(last_move.x);
let y = Math.floor(last_move.y);
let z = Math.floor(last_move.z);
bot.chat('/tp @s ' + x + ' ' + y + ' ' + z);
return true;
}
}
await bot.pathfinder.goto(inverted_goal); await bot.pathfinder.goto(inverted_goal);
let new_pos = bot.entity.position; let new_pos = bot.entity.position;
log(bot, `Moved away from nearest entity to ${new_pos}.`); log(bot, `Moved away from nearest entity to ${new_pos}.`);
return true; return true;
} }
export async function avoidEnemies(bot, distance=16) {
/**
* Move a given distance away from all nearby enemy mobs.
* @param {MinecraftBot} bot, reference to the minecraft bot.
* @param {number} distance, the distance to move away.
* @returns {Promise<boolean>} true if the bot moved away, false otherwise.
* @example
* await skills.avoidEnemies(bot, 8);
**/
bot.modes.pause('self_preservation'); // prevents damage-on-low-health from interrupting the bot
let enemy = world.getNearestEntityWhere(bot, entity => mc.isHostile(entity), distance);
while (enemy) {
const follow = new pf.goals.GoalFollow(enemy, distance+1); // move a little further away
const inverted_goal = new pf.goals.GoalInvert(follow);
bot.pathfinder.setMovements(new pf.Movements(bot));
bot.pathfinder.setGoal(inverted_goal, true);
await new Promise(resolve => setTimeout(resolve, 500));
enemy = world.getNearestEntityWhere(bot, entity => mc.isHostile(entity), distance);
if (bot.interrupt_code) {
break;
}
}
bot.pathfinder.stop();
log(bot, `Moved ${distance} away from enemies.`);
return true;
}
export async function stay(bot) { export async function stay(bot) {
/** /**
* Stay in the current position until interrupted. Disables all modes. * Stay in the current position until interrupted. Disables all modes.
@ -790,6 +889,8 @@ export async function stay(bot) {
* @example * @example
* await skills.stay(bot); * await skills.stay(bot);
**/ **/
bot.modes.pause('self_preservation');
bot.modes.pause('cowardice');
bot.modes.pause('self_defense'); bot.modes.pause('self_defense');
bot.modes.pause('hunting'); bot.modes.pause('hunting');
bot.modes.pause('torch_placing'); bot.modes.pause('torch_placing');

13
src/agent/library/world.js
View file

@ -256,6 +256,19 @@ export async function isClearPath(bot, target) {
return path.status === 'success'; return path.status === 'success';
} }
export function shouldPlaceTorch(bot) {
if (!bot.modes.isOn('torch_placing') || bot.interrupt_code) return false;
const pos = getPosition(bot);
// TODO: check light level instead of nearby torches, block.light is broken
let nearest_torch = getNearestBlock(bot, 'torch', 6);
if (!nearest_torch) {
const block = bot.blockAt(pos);
let has_torch = bot.inventory.items().find(item => item.name === 'torch');
return has_torch && block.name === 'air';
}
return false;
}
export function getBiomeName(bot) { export function getBiomeName(bot) {
/** /**
* Get the name of the biome the bot is in. * Get the name of the biome the bot is in.

25
src/agent/memory_bank.js Normal file
View file

@ -0,0 +1,25 @@
export class MemoryBank {
constructor() {
this.memory = {};
}
rememberPlace(name, x, y, z) {
this.memory[name] = [x, y, z];
}
recallPlace(name) {
return this.memory[name];
}
getJson() {
return this.memory
}
loadJson(json) {
this.memory = json;
}
getKeys() {
return Object.keys(this.memory).join(', ')
}
}

128
src/agent/modes.js
View file

@ -16,24 +16,90 @@ import * as mc from '../utils/mcdata.js';
// to perform longer actions, use the execute function which won't block the update loop // to perform longer actions, use the execute function which won't block the update loop
const modes = [ const modes = [
{ {
name: 'self_defense', name: 'self_preservation',
description: 'Automatically attack nearby enemies. Interrupts other actions.', description: 'Respond to drowning, burning, and damage at low health. Interrupts other actions.',
interrupts: ['all'],
on: true,
active: false,
fall_blocks: ['sand', 'gravel', 'concrete_powder'], // includes matching substrings like 'sandstone' and 'red_sand'
update: async function (agent) {
const bot = agent.bot;
let block = bot.blockAt(bot.entity.position);
let blockAbove = bot.blockAt(bot.entity.position.offset(0, 1, 0));
if (!block) block = {name: 'air'}; // hacky fix when blocks are not loaded
if (!blockAbove) blockAbove = {name: 'air'};
if (blockAbove.name === 'water' || blockAbove.name === 'flowing_water') {
// does not call execute so does not interrupt other actions
if (!bot.pathfinder.goal) {
bot.setControlState('jump', true);
}
}
else if (this.fall_blocks.some(name => blockAbove.name.includes(name))) {
execute(this, agent, async () => {
await skills.moveAway(bot, 2);
});
}
else if (block.name === 'lava' || block.name === 'flowing_lava' || block.name === 'fire' ||
blockAbove.name === 'lava' || blockAbove.name === 'flowing_lava' || blockAbove.name === 'fire') {
bot.chat('I\'m on fire!'); // TODO: gets stuck in lava
execute(this, agent, async () => {
let nearestWater = world.getNearestBlock(bot, 'water', 20);
if (nearestWater) {
const pos = nearestWater.position;
await skills.goToPosition(bot, pos.x, pos.y, pos.z, 0.2);
bot.chat('Ahhhh that\'s better!');
}
else {
await skills.moveAway(bot, 5);
}
});
}
else if (Date.now() - bot.lastDamageTime < 3000 && (bot.health < 5 || bot.lastDamageTaken >= bot.health)) {
bot.chat('I\'m dying!');
execute(this, agent, async () => {
await skills.moveAway(bot, 20);
});
}
else if (agent.isIdle()) {
bot.clearControlStates(); // clear jump if not in danger or doing anything else
}
}
},
{
name: 'cowardice',
description: 'Run away from enemies. Interrupts other actions.',
interrupts: ['all'], interrupts: ['all'],
on: true, on: true,
active: false, active: false,
update: async function (agent) { update: async function (agent) {
const enemy = world.getNearestEntityWhere(agent.bot, entity => mc.isHostile(entity), 9); const enemy = world.getNearestEntityWhere(agent.bot, entity => mc.isHostile(entity), 16);
if (enemy && await world.isClearPath(agent.bot, enemy)) {
agent.bot.chat(`Aaa! A ${enemy.name}!`);
execute(this, agent, async () => {
await skills.avoidEnemies(agent.bot, 24);
});
}
}
},
{
name: 'self_defense',
description: 'Attack nearby enemies. Interrupts other actions.',
interrupts: ['all'],
on: true,
active: false,
update: async function (agent) {
const enemy = world.getNearestEntityWhere(agent.bot, entity => mc.isHostile(entity), 8);
if (enemy && await world.isClearPath(agent.bot, enemy)) { if (enemy && await world.isClearPath(agent.bot, enemy)) {
agent.bot.chat(`Fighting ${enemy.name}!`); agent.bot.chat(`Fighting ${enemy.name}!`);
execute(this, agent, async () => { execute(this, agent, async () => {
await skills.defendSelf(agent.bot, 9); await skills.defendSelf(agent.bot, 8);
}); });
} }
} }
}, },
{ {
name: 'hunting', name: 'hunting',
description: 'Automatically hunt nearby animals when idle.', description: 'Hunt nearby animals when idle.',
interrupts: ['defaults'], interrupts: ['defaults'],
on: true, on: true,
active: false, active: false,
@ -49,7 +115,7 @@ const modes = [
}, },
{ {
name: 'item_collecting', name: 'item_collecting',
description: 'Automatically collect nearby items when idle.', description: 'Collect nearby items when idle.',
interrupts: ['followPlayer'], interrupts: ['followPlayer'],
on: true, on: true,
active: false, active: false,
@ -79,28 +145,26 @@ const modes = [
}, },
{ {
name: 'torch_placing', name: 'torch_placing',
description: 'Automatically place torches when idle and there are no torches nearby.', description: 'Place torches when idle and there are no torches nearby.',
interrupts: ['followPlayer'], interrupts: ['followPlayer'],
on: true, on: true,
active: false, active: false,
cooldown: 5,
last_place: Date.now(),
update: function (agent) { update: function (agent) {
// TODO: check light level instead of nearby torches, block.light is broken if (world.shouldPlaceTorch(agent.bot)) {
const near_torch = world.getNearestBlock(agent.bot, 'torch', 6); if (Date.now() - this.last_place < this.cooldown * 1000) return;
if (!near_torch) { execute(this, agent, async () => {
let torches = agent.bot.inventory.items().filter(item => item.name === 'torch');
if (torches.length > 0) {
const torch = torches[0];
const pos = agent.bot.entity.position; const pos = agent.bot.entity.position;
execute(this, agent, async () => { await skills.placeBlock(agent.bot, 'torch', pos.x, pos.y, pos.z, 'bottom', true);
await skills.placeBlock(agent.bot, torch.name, pos.x, pos.y, pos.z); });
}); this.last_place = Date.now();
}
} }
} }
}, },
{ {
name: 'idle_staring', name: 'idle_staring',
description: 'Non-functional animation to look around at entities when idle.', description: 'Animation to look around at entities when idle.',
interrupts: [], interrupts: [],
on: true, on: true,
active: false, active: false,
@ -135,6 +199,14 @@ const modes = [
} }
} }
}, },
{
name: 'cheat',
description: 'Use cheats to instantly place blocks and teleport.',
interrupts: [],
on: false,
active: false,
update: function (agent) { /* do nothing */ }
}
]; ];
async function execute(mode, agent, func, timeout=-1) { async function execute(mode, agent, func, timeout=-1) {
@ -201,9 +273,29 @@ class ModeController {
if (mode.active) break; if (mode.active) break;
} }
} }
getJson() {
let res = {};
for (let mode of this.modes_list) {
res[mode.name] = mode.on;
}
return res;
}
loadJson(json) {
for (let mode of this.modes_list) {
if (json[mode.name] != undefined) {
mode.on = json[mode.name];
}
}
}
} }
export function initModes(agent) { export function initModes(agent) {
// the mode controller is added to the bot object so it is accessible from anywhere the bot is used // the mode controller is added to the bot object so it is accessible from anywhere the bot is used
agent.bot.modes = new ModeController(agent); agent.bot.modes = new ModeController(agent);
let modes = agent.prompter.getInitModes();
if (modes) {
agent.bot.modes.loadJson(modes);
}
} }

2
src/agent/npc/construction/hole.json → src/agent/npc/construction/dirt_shelter.json
View file

@ -1,5 +1,5 @@
{ {
"name": "hole", "name": "dirt_shelter",
"offset": -2, "offset": -2,
"blocks": [ "blocks": [
[ [

230
src/agent/npc/construction/large_house.json Normal file
View file

@ -0,0 +1,230 @@
{
"name": "large_house",
"offset": -4,
"blocks": [
[
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", ""],
["", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", ""],
["", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", ""],
["", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", ""],
["", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", ""],
["", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", ""],
["", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""]
],
[
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", ""],
["", "cobblestone", "air", "air", "air", "air", "air", "air", "air", "cobblestone", ""],
["", "cobblestone", "air", "air", "air", "air", "air", "air", "air", "cobblestone", ""],
["", "cobblestone", "air", "air", "air", "air", "air", "air", "air", "cobblestone", ""],
["", "cobblestone", "planks", "air", "air", "air", "air", "air", "air", "cobblestone", ""],
["", "cobblestone", "planks", "air", "air", "air", "air", "air", "air", "cobblestone", ""],
["", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""]
],
[
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", ""],
["", "cobblestone", "air", "torch", "air", "air", "air", "torch", "air", "cobblestone", ""],
["", "cobblestone", "air", "air", "air", "air", "air", "air", "air", "cobblestone", ""],
["", "cobblestone", "air", "air", "air", "air", "air", "air", "air", "cobblestone", ""],
["", "cobblestone", "air", "air", "air", "air", "air", "air", "air", "cobblestone", ""],
["", "cobblestone", "planks", "torch", "air", "air", "air", "torch", "air", "cobblestone", ""],
["", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""]
],
[
["", "", "", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "", "", ""],
["", "", "", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "", "", ""],
["", "", "", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "", "", ""],
["cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", ""],
["cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", ""],
["cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", ""],
["cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", ""],
["cobblestone", "cobblestone", "air", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "dirt"],
["cobblestone", "cobblestone", "air", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", ""],
["cobblestone", "cobblestone", "air", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", ""],
["", "", "", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", ""],
["", "", "", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", ""],
["", "", "", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", ""],
["", "", "", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone", ""]
],
[
["", "", "", "log", "planks", "planks", "planks", "log", "", "", ""],
["", "", "", "planks", "furnace", "air", "crafting_table", "planks", "", "", ""],
["", "", "", "planks", "air", "air", "air", "planks", "", "", ""],
["log", "planks", "planks", "log", "planks", "air", "planks", "log", "planks", "log", ""],
["planks", "planks", "air", "air", "air", "air", "air", "air", "air", "planks", ""],
["planks", "planks", "air", "air", "air", "air", "air", "air", "air", "planks", ""],
["planks", "planks", "air", "air", "air", "air", "air", "air", "air", "door", "air"],
["planks", "planks", "air", "air", "air", "air", "air", "air", "air", "planks", ""],
["planks", "planks", "air", "air", "air", "air", "air", "air", "air", "planks", ""],
["log", "planks", "planks", "log", "planks", "planks", "air", "planks", "planks", "log", ""],
["", "", "", "planks", "air", "air", "air", "", "air", "planks", ""],
["", "", "", "planks", "chest", "air", "air", "bed", "", "planks", ""],
["", "", "", "planks", "chest", "air", "air", "", "air", "planks", ""],
["", "", "", "log", "planks", "planks", "planks", "planks", "planks", "log", ""]
],
[
["", "", "", "log", "planks", "planks", "planks", "log", "", "", ""],
["", "", "", "planks", "air", "air", "air", "glass", "", "", ""],
["", "", "", "planks", "air", "air", "air", "glass", "", "", ""],
["log", "planks", "planks", "log", "planks", "air", "planks", "log", "planks", "log", ""],
["planks", "air", "air", "air", "air", "air", "air", "air", "air", "planks", ""],
["planks", "planks", "air", "air", "air", "air", "air", "air", "air", "planks", ""],
["planks", "planks", "air", "air", "air", "air", "air", "air", "air", "door", "air"],
["planks", "planks", "air", "air", "air", "air", "air", "air", "air", "planks", ""],
["planks", "planks", "air", "air", "air", "air", "air", "air", "air", "planks", ""],
["log", "planks", "planks", "log", "planks", "planks", "air", "planks", "planks", "log", ""],
["", "", "", "planks", "air", "air", "air", "air", "air", "planks", ""],
["", "", "", "planks", "air", "air", "air", "air", "air", "planks", ""],
["", "", "", "planks", "air", "air", "air", "air", "air", "planks", ""],
["", "", "", "log", "planks", "glass", "glass", "glass", "planks", "log", ""]
],
[
["", "", "", "log", "planks", "planks", "planks", "log", "", "", ""],
["", "", "", "planks", "air", "air", "air", "glass", "", "", ""],
["", "", "", "planks", "torch", "air", "torch", "glass", "", "", ""],
["log", "planks", "planks", "log", "planks", "air", "planks", "log", "planks", "log", ""],
["planks", "air", "air", "torch", "air", "air", "air", "air", "air", "planks", ""],
["planks", "air", "air", "air", "air", "air", "air", "air", "torch", "planks", ""],
["planks", "planks", "air", "air", "air", "air", "air", "air", "air", "planks", ""],
["planks", "planks", "air", "air", "air", "air", "air", "air", "torch", "planks", ""],
["planks", "planks", "air", "torch", "air", "air", "air", "air", "air", "planks", ""],
["log", "planks", "planks", "log", "planks", "planks", "air", "planks", "planks", "log", ""],
["", "", "", "planks", "air", "torch", "air", "torch", "air", "planks", ""],
["", "", "", "planks", "air", "air", "air", "air", "air", "planks", ""],
["", "", "", "planks", "air", "air", "air", "air", "air", "planks", ""],
["", "", "", "log", "planks", "glass", "glass", "glass", "planks", "log", ""]
],
[
["", "", "", "log", "log", "log", "log", "log", "", "", ""],
["", "", "", "log", "planks", "planks", "planks", "log", "", "", ""],
["", "", "", "log", "planks", "planks", "planks", "log", "", "", ""],
["log", "log", "log", "log", "log", "log", "log", "log", "log", "log", ""],
["log", "air", "planks", "planks", "planks", "planks", "planks", "planks", "planks", "log", ""],
["log", "air", "planks", "planks", "planks", "planks", "planks", "planks", "planks", "log", ""],
["log", "air", "planks", "planks", "planks", "planks", "planks", "planks", "planks", "log", ""],
["log", "planks", "planks", "planks", "planks", "planks", "planks", "planks", "planks", "log", ""],
["log", "planks", "planks", "planks", "planks", "planks", "planks", "planks", "planks", "log", ""],
["log", "log", "log", "log", "log", "log", "log", "log", "log", "log", ""],
["", "", "", "log", "planks", "planks", "planks", "planks", "planks", "log", ""],
["", "", "", "log", "planks", "planks", "planks", "planks", "planks", "log", ""],
["", "", "", "log", "planks", "planks", "planks", "planks", "planks", "log", ""],
["", "", "", "log", "log", "log", "log", "log", "log", "log", ""]
],
[
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "planks", "planks", "planks", "", "", "", ""],
["", "", "", "", "planks", "planks", "planks", "", "", "", ""],
["log", "planks", "planks", "log", "planks", "planks", "planks", "planks", "planks", "log", ""],
["planks", "air", "bookshelf", "bookshelf", "air", "air", "air", "air", "torch", "planks", ""],
["planks", "air", "air", "air", "air", "air", "air", "air", "air", "planks", ""],
["planks", "air", "air", "air", "air", "air", "air", "air", "air", "planks", ""],
["planks", "air", "air", "air", "air", "air", "air", "air", "air", "planks", ""],
["planks", "air", "air", "air", "air", "air", "air", "air", "torch", "planks", ""],
["log", "planks", "planks", "log", "planks", "planks", "planks", "planks", "planks", "log", ""],
["", "", "", "", "planks", "planks", "planks", "planks", "planks", "", ""],
["", "", "", "", "planks", "planks", "planks", "planks", "planks", "", ""],
["", "", "", "", "planks", "planks", "planks", "planks", "planks", "", ""],
["", "", "", "", "", "", "", "", "", "", ""]
],
[
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["log", "planks", "planks", "log", "glass", "glass", "glass", "glass", "glass", "log", ""],
["glass", "air", "bookshelf", "bookshelf", "air", "air", "air", "air", "air", "planks", ""],
["glass", "air", "air", "air", "air", "air", "air", "air", "air", "glass", ""],
["glass", "air", "air", "air", "air", "air", "air", "air", "air", "glass", ""],
["glass", "air", "air", "air", "air", "air", "air", "air", "air", "glass", ""],
["glass", "air", "air", "air", "air", "air", "air", "air", "air", "glass", ""],
["log", "planks", "planks", "log", "glass", "glass", "glass", "glass", "glass", "log", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""]
],
[
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["log", "planks", "planks", "log", "glass", "glass", "glass", "glass", "glass", "log", ""],
["glass", "air", "air", "torch", "air", "air", "air", "air", "air", "glass", ""],
["glass", "air", "air", "air", "air", "air", "air", "air", "air", "glass", ""],
["glass", "air", "air", "air", "air", "air", "air", "air", "air", "glass", ""],
["glass", "air", "air", "air", "air", "air", "air", "air", "air", "glass", ""],
["glass", "air", "air", "torch", "air", "air", "air", "air", "air", "glass", ""],
["log", "planks", "planks", "log", "glass", "glass", "glass", "glass", "glass", "log", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""]
],
[
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["log", "log", "log", "log", "log", "log", "log", "log", "log", "log", ""],
["log", "planks", "planks", "log", "planks", "planks", "planks", "planks", "planks", "log", ""],
["log", "planks", "planks", "log", "planks", "planks", "planks", "planks", "planks", "log", ""],
["log", "planks", "planks", "log", "planks", "planks", "planks", "planks", "planks", "log", ""],
["log", "planks", "planks", "log", "planks", "planks", "planks", "planks", "planks", "log", ""],
["log", "planks", "planks", "log", "planks", "planks", "planks", "planks", "planks", "log", ""],
["log", "log", "log", "log", "log", "log", "log", "log", "log", "log", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""]
],
[
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "planks", "planks", "planks", "planks", "planks", "", ""],
["", "", "", "", "planks", "planks", "planks", "planks", "planks", "", ""],
["", "", "", "", "planks", "planks", "planks", "planks", "planks", "", ""],
["", "", "", "", "planks", "planks", "planks", "planks", "planks", "", ""],
["", "", "", "", "planks", "planks", "planks", "planks", "planks", "", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""]
],
[
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "planks", "planks", "planks", "", "", ""],
["", "", "", "", "", "planks", "planks", "planks", "", "", ""],
["", "", "", "", "", "planks", "planks", "planks", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""],
["", "", "", "", "", "", "", "", "", "", ""]
]
]
}

42
src/agent/npc/construction/small_stone_house.json Normal file
View file

@ -0,0 +1,42 @@
{
"name": "small_stone_house",
"offset": -1,
"blocks": [
[
["", "", "", "", ""],
["", "planks", "planks", "planks", ""],
["", "planks", "planks", "planks", ""],
["", "planks", "planks", "planks", ""],
["", "planks", "planks", "planks", ""],
["", "", "planks", "", ""],
["", "", "", "", ""]
],
[
["cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone"],
["cobblestone", "chest", "bed", "air", "cobblestone"],
["cobblestone", "air", "bed", "air", "cobblestone"],
["cobblestone", "air", "air", "air", "cobblestone"],
["cobblestone", "air", "air", "air", "cobblestone"],
["cobblestone", "cobblestone", "door", "cobblestone", "cobblestone"],
["", "air", "air", "air", ""]
],
[
["cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone"],
["cobblestone", "torch", "air", "torch", "cobblestone"],
["cobblestone", "air", "air", "air", "cobblestone"],
["cobblestone", "air", "air", "air", "cobblestone"],
["cobblestone", "torch", "air", "torch", "cobblestone"],
["cobblestone", "cobblestone", "door", "cobblestone", "cobblestone"],
["", "air", "air", "air", ""]
],
[
["air", "air", "air", "air", "air"],
["air", "cobblestone", "cobblestone", "cobblestone", "air"],
["cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone"],
["cobblestone", "cobblestone", "cobblestone", "cobblestone", "cobblestone"],
["air", "cobblestone", "cobblestone", "cobblestone", "air"],
["air", "air", "air", "air", "air"],
["", "air", "air", "air", ""]
]
]
}

2
src/agent/npc/construction/house.json → src/agent/npc/construction/small_wood_house.json
View file

@ -1,5 +1,5 @@
{ {
"name": "shelter", "name": "small_wood_house",
"offset": -1, "offset": -1,
"blocks": [ "blocks": [
[ [

50
src/agent/npc/controller.js
View file

@ -11,11 +11,12 @@ import * as mc from '../../utils/mcdata.js';
export class NPCContoller { export class NPCContoller {
constructor(agent) { constructor(agent) {
this.agent = agent; this.agent = agent;
this.data = NPCData.fromObject(agent.prompter.prompts.npc); this.data = NPCData.fromObject(agent.prompter.profile.npc);
this.temp_goals = []; this.temp_goals = [];
this.item_goal = new ItemGoal(agent, this.data); this.item_goal = new ItemGoal(agent, this.data);
this.build_goal = new BuildGoal(agent); this.build_goal = new BuildGoal(agent);
this.constructions = {}; this.constructions = {};
this.last_goals = {};
} }
getBuiltPositions() { getBuiltPositions() {
@ -38,8 +39,6 @@ export class NPCContoller {
} }
init() { init() {
if (this.data === null) return;
for (let file of readdirSync('src/agent/npc/construction')) { for (let file of readdirSync('src/agent/npc/construction')) {
if (file.endsWith('.json')) { if (file.endsWith('.json')) {
try { try {
@ -67,6 +66,7 @@ export class NPCContoller {
} }
this.agent.bot.on('idle', async () => { this.agent.bot.on('idle', async () => {
if (this.data.goals.length === 0 && !this.data.curr_goal) return;
// Wait a while for inputs before acting independently // Wait a while for inputs before acting independently
await new Promise((resolve) => setTimeout(resolve, 5000)); await new Promise((resolve) => setTimeout(resolve, 5000));
if (!this.agent.isIdle()) return; if (!this.agent.isIdle()) return;
@ -79,13 +79,36 @@ export class NPCContoller {
}); });
} }
async setGoal(name=null, quantity=1) {
this.data.curr_goal = null;
this.last_goals = {};
if (name) {
this.data.curr_goal = {name: name, quantity: quantity};
return;
}
if (!this.data.do_set_goal) return;
let past_goals = {...this.last_goals};
for (let goal in this.data.goals) {
if (past_goals[goal.name] === undefined) past_goals[goal.name] = true;
}
let res = await this.agent.prompter.promptGoalSetting(this.agent.history.getHistory(), past_goals);
if (res) {
this.data.curr_goal = res;
console.log('Set new goal: ', res.name, ' x', res.quantity);
} else {
console.log('Error setting new goal.');
}
}
async executeNext() { async executeNext() {
if (!this.agent.isIdle()) return; if (!this.agent.isIdle()) return;
await this.agent.coder.execute(async () => { await this.agent.coder.execute(async () => {
await skills.moveAway(this.agent.bot, 2); await skills.moveAway(this.agent.bot, 2);
}); });
if (this.agent.bot.time.timeOfDay < 13000) { if (!this.data.do_routine || this.agent.bot.time.timeOfDay < 13000) {
// Exit any buildings // Exit any buildings
let building = this.currentBuilding(); let building = this.currentBuilding();
if (building == this.data.home) { if (building == this.data.home) {
@ -102,6 +125,9 @@ export class NPCContoller {
await this.executeGoal(); await this.executeGoal();
} else { } else {
// Reset goal at the end of the day
this.data.curr_goal = null;
// Return to home // Return to home
let building = this.currentBuilding(); let building = this.currentBuilding();
if (this.data.home !== null && (building === null || building != this.data.home)) { if (this.data.home !== null && (building === null || building != this.data.home)) {
@ -124,14 +150,19 @@ export class NPCContoller {
async executeGoal() { async executeGoal() {
// If we need more blocks to complete a building, get those first // If we need more blocks to complete a building, get those first
let goals = this.temp_goals.concat(this.data.goals); let goals = this.temp_goals.concat(this.data.goals);
if (this.data.curr_goal)
goals = goals.concat([this.data.curr_goal])
this.temp_goals = []; this.temp_goals = [];
let acted = false;
for (let goal of goals) { for (let goal of goals) {
// Obtain goal item or block // Obtain goal item or block
if (this.constructions[goal.name] === undefined) { if (this.constructions[goal.name] === undefined) {
if (!itemSatisfied(this.agent.bot, goal.name, goal.quantity)) { if (!itemSatisfied(this.agent.bot, goal.name, goal.quantity)) {
await this.item_goal.executeNext(goal.name, goal.quantity); let res = await this.item_goal.executeNext(goal.name, goal.quantity);
this.last_goals[goal.name] = res;
acted = true;
break; break;
} }
} }
@ -162,9 +193,16 @@ export class NPCContoller {
quantity: res.missing[block_name] quantity: res.missing[block_name]
}) })
} }
if (res.acted) break; if (res.acted) {
acted = true;
this.last_goals[goal.name] = Object.keys(res.missing).length === 0;
break;
}
} }
} }
if (!acted && this.data.do_set_goal)
await this.setGoal();
} }
currentBuilding() { currentBuilding() {

15
src/agent/npc/data.js
View file

@ -1,24 +1,31 @@
export class NPCData { export class NPCData {
constructor() { constructor() {
this.goals = []; this.goals = [];
this.curr_goal = null;
this.built = {}; this.built = {};
this.home = null; this.home = null;
this.do_routine = false;
this.do_set_goal = false;
} }
toObject() { toObject() {
let obj = {}; let obj = {};
if (this.goals.length > 0) if (this.goals.length > 0)
obj.goals = this.goals; obj.goals = this.goals;
if (this.curr_goal)
obj.curr_goal = this.curr_goal;
if (Object.keys(this.built).length > 0) if (Object.keys(this.built).length > 0)
obj.built = this.built; obj.built = this.built;
if (this.home) if (this.home)
obj.home = this.home; obj.home = this.home;
obj.do_routine = this.do_routine;
obj.do_set_goal = this.do_set_goal;
return obj; return obj;
} }
static fromObject(obj) { static fromObject(obj) {
if (!obj) return null;
let npc = new NPCData(); let npc = new NPCData();
if (!obj) return npc;
if (obj.goals) { if (obj.goals) {
npc.goals = []; npc.goals = [];
for (let goal of obj.goals) { for (let goal of obj.goals) {
@ -28,10 +35,16 @@ export class NPCData {
npc.goals.push({name: goal.name, quantity: goal.quantity}); npc.goals.push({name: goal.name, quantity: goal.quantity});
} }
} }
if (obj.curr_goal)
npc.curr_goal = obj.curr_goal;
if (obj.built) if (obj.built)
npc.built = obj.built; npc.built = obj.built;
if (obj.home) if (obj.home)
npc.home = obj.home; npc.home = obj.home;
if (obj.do_routine !== undefined)
npc.do_routine = obj.do_routine;
if (obj.do_set_goal !== undefined)
npc.do_set_goal = obj.do_set_goal;
return npc; return npc;
} }
} }

7
src/agent/npc/item_goal.js
View file

@ -309,7 +309,7 @@ export class ItemGoal {
let next_info = this.goal.getNext(item_quantity); let next_info = this.goal.getNext(item_quantity);
if (!next_info) { if (!next_info) {
console.log(`Invalid item goal ${this.goal.name}`); console.log(`Invalid item goal ${this.goal.name}`);
return; return false;
} }
let next = next_info.node; let next = next_info.node;
let quantity = next_info.quantity; let quantity = next_info.quantity;
@ -330,12 +330,12 @@ export class ItemGoal {
await new Promise((resolve) => setTimeout(resolve, 500)); await new Promise((resolve) => setTimeout(resolve, 500));
this.agent.bot.emit('idle'); this.agent.bot.emit('idle');
} }
return; return false;
} }
// Wait for the bot to be idle before attempting to execute the next goal // Wait for the bot to be idle before attempting to execute the next goal
if (!this.agent.isIdle()) if (!this.agent.isIdle())
return; return false;
// Execute the next goal // Execute the next goal
let init_quantity = world.getInventoryCounts(this.agent.bot)[next.name] || 0; let init_quantity = world.getInventoryCounts(this.agent.bot)[next.name] || 0;
@ -350,5 +350,6 @@ export class ItemGoal {
} else { } else {
console.log(`Failed to obtain ${next.name} for goal ${this.goal.name}`); console.log(`Failed to obtain ${next.name} for goal ${this.goal.name}`);
} }
return final_quantity > init_quantity;
} }
} }

151
src/agent/prompter.js
View file

@ -8,46 +8,100 @@ import { getCommand } from './commands/index.js';
import { Gemini } from '../models/gemini.js'; import { Gemini } from '../models/gemini.js';
import { GPT } from '../models/gpt.js'; import { GPT } from '../models/gpt.js';
import { Claude } from '../models/claude.js'; import { Claude } from '../models/claude.js';
import { ReplicateAPI } from '../models/replicate.js';
import { Local } from '../models/local.js';
export class Prompter { export class Prompter {
constructor(agent, fp) { constructor(agent, fp) {
this.prompts = JSON.parse(readFileSync(fp, 'utf8'));
let name = this.prompts.name;
this.agent = agent; this.agent = agent;
let model_name = this.prompts.model; this.profile = JSON.parse(readFileSync(fp, 'utf8'));
this.convo_examples = null;
this.coding_examples = null;
let name = this.profile.name;
let chat = this.profile.model;
if (typeof chat === 'string' || chat instanceof String) {
chat = {model: chat};
if (chat.model.includes('gemini'))
chat.api = 'google';
else if (chat.model.includes('gpt'))
chat.api = 'openai';
else if (chat.model.includes('claude'))
chat.api = 'anthropic';
else if (chat.model.includes('meta/') || chat.model.includes('mistralai/') || chat.model.includes('replicate/'))
chat.api = 'replicate';
else
chat.api = 'ollama';
}
console.log('Using chat settings:', chat);
if (chat.api == 'google')
this.chat_model = new Gemini(chat.model, chat.url);
else if (chat.api == 'openai')
this.chat_model = new GPT(chat.model, chat.url);
else if (chat.api == 'anthropic')
this.chat_model = new Claude(chat.model, chat.url);
else if (chat.api == 'replicate')
this.chat_model = new ReplicateAPI(chat.model, chat.url);
else if (chat.api == 'ollama')
this.chat_model = new Local(chat.model, chat.url);
else
throw new Error('Unknown API:', api);
let embedding = this.profile.embedding;
if (embedding === undefined) {
if (chat.api !== 'ollama')
embedding = {api: chat.api};
else
embedding = {api: 'none'};
}
else if (typeof embedding === 'string' || embedding instanceof String)
embedding = {api: embedding};
console.log('Using embedding settings:', embedding);
if (embedding.api == 'google')
this.embedding_model = new Gemini(embedding.model, embedding.url);
else if (embedding.api == 'openai')
this.embedding_model = new GPT(embedding.model, embedding.url);
else if (embedding.api == 'replicate')
this.embedding_model = new ReplicateAPI(embedding.model, embedding.url);
else if (embedding.api == 'ollama')
this.embedding_model = new Local(embedding.model, embedding.url);
else {
this.embedding_model = null;
console.log('Unknown embedding: ', embedding ? embedding.api : '[NOT SPECIFIED]', '. Using word overlap.');
}
mkdirSync(`./bots/${name}`, { recursive: true }); mkdirSync(`./bots/${name}`, { recursive: true });
writeFileSync(`./bots/${name}/last_profile.json`, JSON.stringify(this.prompts, null, 4), (err) => { writeFileSync(`./bots/${name}/last_profile.json`, JSON.stringify(this.profile, null, 4), (err) => {
if (err) { if (err) {
throw err; throw err;
} }
console.log("Copy profile saved."); console.log("Copy profile saved.");
}); });
if (model_name.includes('gemini'))
this.model = new Gemini(model_name);
else if (model_name.includes('gpt'))
this.model = new GPT(model_name);
else if (model_name.includes('claude'))
this.model = new Claude(model_name);
else
throw new Error('Unknown model ' + model_name);
} }
getName() { getName() {
return this.prompts.name; return this.profile.name;
}
getInitModes() {
return this.profile.modes;
} }
async initExamples() { async initExamples() {
console.log('Loading examples...') console.log('Loading examples...')
this.convo_examples = new Examples(this.model); this.convo_examples = new Examples(this.embedding_model);
await this.convo_examples.load(this.prompts.conversation_examples); await this.convo_examples.load(this.profile.conversation_examples);
this.coding_examples = new Examples(this.model); this.coding_examples = new Examples(this.embedding_model);
await this.coding_examples.load(this.prompts.coding_examples); await this.coding_examples.load(this.profile.coding_examples);
console.log('Examples loaded.'); console.log('Examples loaded.');
} }
async replaceStrings(prompt, messages, examples=null, prev_memory=null, to_summarize=[]) { async replaceStrings(prompt, messages, examples=null, prev_memory=null, to_summarize=[], last_goals=null) {
prompt = prompt.replaceAll('$NAME', this.agent.name); prompt = prompt.replaceAll('$NAME', this.agent.name);
if (prompt.includes('$STATS')) { if (prompt.includes('$STATS')) {
@ -68,6 +122,27 @@ export class Prompter {
prompt = prompt.replaceAll('$MEMORY', prev_memory ? prev_memory : 'None.'); prompt = prompt.replaceAll('$MEMORY', prev_memory ? prev_memory : 'None.');
if (prompt.includes('$TO_SUMMARIZE')) if (prompt.includes('$TO_SUMMARIZE'))
prompt = prompt.replaceAll('$TO_SUMMARIZE', stringifyTurns(to_summarize)); prompt = prompt.replaceAll('$TO_SUMMARIZE', stringifyTurns(to_summarize));
if (prompt.includes('$CONVO'))
prompt = prompt.replaceAll('$CONVO', 'Recent conversation:\n' + stringifyTurns(messages));
if (prompt.includes('$LAST_GOALS')) {
let goal_text = '';
for (let goal in last_goals) {
if (last_goals[goal])
goal_text += `You recently successfully completed the goal ${goal}.\n`
else
goal_text += `You recently failed to complete the goal ${goal}.\n`
}
prompt = prompt.replaceAll('$LAST_GOALS', goal_text.trim());
}
if (prompt.includes('$BLUEPRINTS')) {
if (this.agent.npc.constructions) {
let blueprints = '';
for (let blueprint in this.agent.npc.constructions) {
blueprints += blueprint + ', ';
}
prompt = prompt.replaceAll('$BLUEPRINTS', blueprints.slice(0, -2));
}
}
// check if there are any remaining placeholders with syntax $<word> // check if there are any remaining placeholders with syntax $<word>
let remaining = prompt.match(/\$[A-Z_]+/g); let remaining = prompt.match(/\$[A-Z_]+/g);
@ -78,20 +153,46 @@ export class Prompter {
} }
async promptConvo(messages) { async promptConvo(messages) {
let prompt = this.prompts.conversing; let prompt = this.profile.conversing;
prompt = await this.replaceStrings(prompt, messages, this.convo_examples); prompt = await this.replaceStrings(prompt, messages, this.convo_examples);
return await this.model.sendRequest(messages, prompt); return await this.chat_model.sendRequest(messages, prompt);
} }
async promptCoding(messages) { async promptCoding(messages) {
let prompt = this.prompts.coding; let prompt = this.profile.coding;
prompt = await this.replaceStrings(prompt, messages, this.coding_examples); prompt = await this.replaceStrings(prompt, messages, this.coding_examples);
return await this.model.sendRequest(messages, prompt); return await this.chat_model.sendRequest(messages, prompt);
} }
async promptMemSaving(prev_mem, to_summarize) { async promptMemSaving(prev_mem, to_summarize) {
let prompt = this.prompts.saving_memory; let prompt = this.profile.saving_memory;
prompt = await this.replaceStrings(prompt, null, null, prev_mem, to_summarize); prompt = await this.replaceStrings(prompt, null, null, prev_mem, to_summarize);
return await this.model.sendRequest([], prompt); return await this.chat_model.sendRequest([], prompt);
}
async promptGoalSetting(messages, last_goals) {
let system_message = this.profile.goal_setting;
system_message = await this.replaceStrings(system_message, messages);
let user_message = 'Use the below info to determine what goal to target next\n\n';
user_message += '$LAST_GOALS\n$STATS\n$INVENTORY\n$CONVO'
user_message = await this.replaceStrings(user_message, messages, null, null, null, last_goals);
let user_messages = [{role: 'user', content: user_message}];
let res = await this.chat_model.sendRequest(user_messages, system_message);
let goal = null;
try {
let data = res.split('```')[1].replace('json', '').trim();
goal = JSON.parse(data);
} catch (err) {
console.log('Failed to parse goal:', res, err);
}
if (!goal || !goal.name || !goal.quantity || isNaN(parseInt(goal.quantity))) {
console.log('Failed to set goal:', res);
return null;
}
goal.quantity = parseInt(goal.quantity);
return goal;
} }
} }

61
src/models/claude.js
View file

@ -1,59 +1,28 @@
import Anthropic from '@anthropic-ai/sdk'; import Anthropic from '@anthropic-ai/sdk';
import { GPT } from './gpt.js'; import { strictFormat } from '../utils/text.js';
import { getKey } from '../utils/keys.js';
export class Claude { export class Claude {
constructor(model_name) { constructor(model_name, url) {
this.model_name = model_name; this.model_name = model_name;
if (!process.env.ANTHROPIC_API_KEY) {
throw new Error('Anthropic API key missing! Make sure you set your ANTHROPIC_API_KEY environment variable.');
}
this.anthropic = new Anthropic({ let config = {};
apiKey: process.env["ANTHROPIC_API_KEY"] if (url)
}); config.baseURL = url;
this.gpt = undefined; config.apiKey = getKey('ANTHROPIC_API_KEY');
try {
this.gpt = new GPT(); // use for embeddings, ignore model this.anthropic = new Anthropic(config);
} catch (err) {
console.warn('Claude uses the OpenAI API for embeddings, but no OPENAI_API_KEY env variable was found. Claude will still work, but performance will suffer.');
}
} }
async sendRequest(turns, systemMessage) { async sendRequest(turns, systemMessage) {
let prev_role = null; const messages = strictFormat(turns);
let messages = [];
let filler = {role: 'user', content: '_'};
for (let msg of turns) {
if (msg.role === 'system') {
msg.role = 'user';
msg.content = 'SYSTEM: ' + msg.content;
}
if (msg.role === prev_role && msg.role === 'assistant') {
// insert empty user message to separate assistant messages
messages.push(filler);
messages.push(msg);
}
else if (msg.role === prev_role) {
// combine new message with previous message instead of adding a new one
messages[messages.length-1].content += '\n' + msg.content;
}
else {
messages.push(msg);
}
prev_role = msg.role;
}
if (messages.length === 0) {
messages.push(filler);
}
let res = null; let res = null;
try { try {
console.log('Awaiting anthropic api response...') console.log('Awaiting anthropic api response...')
console.log('Messages:', messages); // console.log('Messages:', messages);
const resp = await this.anthropic.messages.create({ const resp = await this.anthropic.messages.create({
model: this.model_name, model: this.model_name || "claude-3-sonnet-20240229",
system: systemMessage, system: systemMessage,
max_tokens: 2048, max_tokens: 2048,
messages: messages, messages: messages,
@ -69,11 +38,7 @@ export class Claude {
} }
async embed(text) { async embed(text) {
if (this.gpt) { throw new Error('Embeddings are not supported by Claude.');
return await this.gpt.embed(text);
}
// if no gpt, just return random embedding
return Array(1).fill().map(() => Math.random());
} }
} }

62
src/models/gemini.js
View file

@ -1,36 +1,54 @@
import { GoogleGenerativeAI } from '@google/generative-ai'; import { GoogleGenerativeAI } from '@google/generative-ai';
import { toSinglePrompt } from '../utils/text.js';
import { getKey } from '../utils/keys.js';
export class Gemini { export class Gemini {
constructor(model_name) { constructor(model_name, url) {
if (!process.env.GEMINI_API_KEY) { this.model_name = model_name;
throw new Error('Gemini API key missing! Make sure you set your GEMINI_API_KEY environment variable.'); this.url = url;
}
this.genAI = new GoogleGenerativeAI(process.env.GEMINI_API_KEY);
this.genAI = new GoogleGenerativeAI(getKey('GEMINI_API_KEY'));
this.llmModel = this.genAI.getGenerativeModel({ model: model_name });
this.embedModel = this.genAI.getGenerativeModel({ model: "embedding-001"});
} }
async sendRequest(turns, systemMessage) { async sendRequest(turns, systemMessage) {
const messages = [{'role': 'system', 'content': systemMessage}].concat(turns); let model;
let prompt = ""; if (this.url) {
let role = ""; model = this.genAI.getGenerativeModel(
messages.forEach((message) => { {model: this.model_name || "gemini-pro"},
role = message.role; {baseUrl: this.url}
if (role === 'assistant') role = 'model'; );
prompt += `${role}: ${message.content}\n`; } else {
}); model = this.genAI.getGenerativeModel(
if (role !== "model") // if the last message was from the user/system, add a prompt for the model. otherwise, pretend we are extending the model's own message {model: this.model_name || "gemini-pro"}
prompt += "model: "; );
console.log(prompt) }
const result = await this.llmModel.generateContent(prompt);
const stop_seq = '***';
const prompt = toSinglePrompt(turns, systemMessage, stop_seq, 'model');
console.log('Awaiting Google API response...');
const result = await model.generateContent(prompt);
const response = await result.response; const response = await result.response;
return response.text(); const text = response.text();
console.log('Received.');
if (!text.includes(stop_seq)) return text;
const idx = text.indexOf(stop_seq);
return text.slice(0, idx);
} }
async embed(text) { async embed(text) {
const result = await this.embedModel.embedContent(text); let model;
if (this.url) {
model = this.genAI.getGenerativeModel(
{model: this.model_name || "embedding-001"},
{baseUrl: this.url}
);
} else {
model = this.genAI.getGenerativeModel(
{model: this.model_name || "embedding-001"}
);
}
const result = await model.embedContent(text);
return result.embedding; return result.embedding;
} }
} }

35
src/models/gpt.js
View file

@ -1,25 +1,20 @@
import OpenAIApi from 'openai'; import OpenAIApi from 'openai';
import { getKey, hasKey } from '../utils/keys.js';
export class GPT { export class GPT {
constructor(model_name) { constructor(model_name, url) {
this.model_name = model_name; this.model_name = model_name;
let openAiConfig = null;
if (process.env.OPENAI_ORG_ID) {
openAiConfig = {
organization: process.env.OPENAI_ORG_ID,
apiKey: process.env.OPENAI_API_KEY,
};
}
else if (process.env.OPENAI_API_KEY) {
openAiConfig = {
apiKey: process.env.OPENAI_API_KEY,
};
}
else {
throw new Error('OpenAI API key missing! Make sure you set your OPENAI_API_KEY environment variable.');
}
this.openai = new OpenAIApi(openAiConfig); let config = {};
if (url)
config.baseURL = url;
if (hasKey('OPENAI_ORG_ID'))
config.organization = getKey('OPENAI_ORG_ID');
config.apiKey = getKey('OPENAI_API_KEY');
this.openai = new OpenAIApi(config);
} }
async sendRequest(turns, systemMessage, stop_seq='***') { async sendRequest(turns, systemMessage, stop_seq='***') {
@ -29,9 +24,9 @@ export class GPT {
let res = null; let res = null;
try { try {
console.log('Awaiting openai api response...') console.log('Awaiting openai api response...')
console.log('Messages:', messages); // console.log('Messages:', messages);
let completion = await this.openai.chat.completions.create({ let completion = await this.openai.chat.completions.create({
model: this.model_name, model: this.model_name || "gpt-3.5-turbo",
messages: messages, messages: messages,
stop: stop_seq, stop: stop_seq,
}); });
@ -54,7 +49,7 @@ export class GPT {
async embed(text) { async embed(text) {
const embedding = await this.openai.embeddings.create({ const embedding = await this.openai.embeddings.create({
model: "text-embedding-ada-002", model: this.model_name || "text-embedding-ada-002",
input: text, input: text,
encoding_format: "float", encoding_format: "float",
}); });

60
src/models/local.js Normal file
View file

@ -0,0 +1,60 @@
import { strictFormat } from '../utils/text.js';
export class Local {
constructor(model_name, url) {
this.model_name = model_name;
this.url = url || 'http://127.0.0.1:11434';
this.chat_endpoint = '/api/chat';
this.embedding_endpoint = '/api/embeddings';
}
async sendRequest(turns, systemMessage) {
let model = this.model_name || 'llama3';
let messages = strictFormat(turns);
messages.unshift({role: 'system', content: systemMessage});
let res = null;
try {
console.log(`Awaiting local response... (model: ${model})`)
res = await this.send(this.chat_endpoint, {model: model, messages: messages, stream: false});
if (res)
res = res['message']['content'];
}
catch (err) {
if (err.message.toLowerCase().includes('context length') && turns.length > 1) {
console.log('Context length exceeded, trying again with shorter context.');
return await sendRequest(turns.slice(1), systemMessage, stop_seq);
} else {
console.log(err);
res = 'My brain disconnected, try again.';
}
}
return res;
}
async embed(text) {
let model = this.model_name || 'nomic-embed-text';
let body = {model: model, prompt: text};
let res = await this.send(this.embedding_endpoint, body);
return res['embedding']
}
async send(endpoint, body) {
const url = new URL(endpoint, this.url);
let method = 'POST';
let headers = new Headers();
const request = new Request(url, {method, headers, body: JSON.stringify(body)});
let data = null;
try {
const res = await fetch(request);
if (res.ok) {
data = await res.json();
} else {
throw new Error(`Ollama Status: ${res.status}`);
}
} catch (err) {
console.error('Failed to send Ollama request.');
console.error(err);
}
return data;
}
}

54
src/models/replicate.js Normal file
View file

@ -0,0 +1,54 @@
import Replicate from 'replicate';
import { toSinglePrompt } from '../utils/text.js';
import { getKey } from '../utils/keys.js';
// llama, mistral
export class ReplicateAPI {
constructor(model_name, url) {
this.model_name = model_name;
this.url = url;
if (this.url) {
console.warn('Replicate API does not support custom URLs. Ignoring provided URL.');
}
this.replicate = new Replicate({
auth: getKey('REPLICATE_API_KEY'),
});
}
async sendRequest(turns, systemMessage) {
const stop_seq = '***';
const prompt = toSinglePrompt(turns, null, stop_seq);
let model_name = this.model_name || 'meta/meta-llama-3-70b-instruct';
const input = { prompt, system_prompt: systemMessage };
let res = null;
try {
console.log('Awaiting Replicate API response...');
let result = '';
for await (const event of this.replicate.stream(model_name, { input })) {
result += event;
if (result === '') break;
if (result.includes(stop_seq)) {
result = result.slice(0, result.indexOf(stop_seq));
break;
}
}
res = result;
} catch (err) {
console.log(err);
res = 'My brain disconnected, try again.';
}
console.log('Received.');
return res;
}
async embed(text) {
const output = await this.replicate.run(
this.model_name || "mark3labs/embeddings-gte-base:d619cff29338b9a37c3d06605042e1ff0594a8c3eff0175fd6967f5643fc4d47",
{ input: {text} }
);
return output.vectors;
}
}

2
src/process/agent-process.js
View file

@ -25,7 +25,7 @@ export class AgentProcess {
process.exit(1); process.exit(1);
} }
console.log('Restarting agent...'); console.log('Restarting agent...');
this.start(profile, true, 'Agent process restarted. Notify the user and decide what to do.'); this.start(profile, true, 'Agent process restarted.');
last_restart = Date.now(); last_restart = Date.now();
} }
}); });

2
src/settings.js
View file

@ -1,2 +0,0 @@
import { readFileSync } from 'fs';
export default JSON.parse(readFileSync('./settings.json', 'utf8'));

64
src/utils/examples.js
View file

@ -6,34 +6,54 @@ export class Examples {
this.examples = []; this.examples = [];
this.model = model; this.model = model;
this.select_num = select_num; this.select_num = select_num;
this.embeddings = {};
}
turnsToText(turns) {
let messages = '';
for (let turn of turns) {
if (turn.role !== 'assistant')
messages += turn.content.substring(turn.content.indexOf(':')+1).trim() + '\n';
}
return messages.trim();
}
getWords(text) {
return text.replace(/[^a-zA-Z ]/g, '').toLowerCase().split(' ');
}
wordOverlapScore(text1, text2) {
const words1 = this.getWords(text1);
const words2 = this.getWords(text2);
const intersection = words1.filter(word => words2.includes(word));
return intersection.length / (words1.length + words2.length - intersection.length);
} }
async load(examples) { async load(examples) {
this.examples = []; this.examples = examples;
let promises = examples.map(async (example) => { if (this.model !== null) {
let messages = ''; for (let example of this.examples) {
for (let turn of example) { let turn_text = this.turnsToText(example);
if (turn.role === 'user') this.embeddings[turn_text] = await this.model.embed(turn_text);
messages += turn.content.substring(turn.content.indexOf(':')+1).trim() + '\n';
} }
messages = messages.trim(); }
const embedding = await this.model.embed(messages);
return {'embedding': embedding, 'turns': example};
});
this.examples = await Promise.all(promises);
} }
async getRelevant(turns) { async getRelevant(turns) {
let messages = ''; let turn_text = this.turnsToText(turns);
for (let turn of turns) { if (this.model !== null) {
if (turn.role != 'assistant') let embedding = await this.model.embed(turn_text);
messages += turn.content.substring(turn.content.indexOf(':')+1).trim() + '\n'; this.examples.sort((a, b) =>
cosineSimilarity(embedding, this.embeddings[this.turnsToText(b)]) -
cosineSimilarity(embedding, this.embeddings[this.turnsToText(a)])
);
}
else {
this.examples.sort((a, b) =>
this.wordOverlapScore(turn_text, this.turnsToText(b)) -
this.wordOverlapScore(turn_text, this.turnsToText(a))
);
} }
messages = messages.trim();
const embedding = await this.model.embed(messages);
this.examples.sort((a, b) => {
return cosineSimilarity(b.embedding, embedding) - cosineSimilarity(a.embedding, embedding);
});
let selected = this.examples.slice(0, this.select_num); let selected = this.examples.slice(0, this.select_num);
return JSON.parse(JSON.stringify(selected)); // deep copy return JSON.parse(JSON.stringify(selected)); // deep copy
} }
@ -43,13 +63,13 @@ export class Examples {
console.log('selected examples:'); console.log('selected examples:');
for (let example of selected_examples) { for (let example of selected_examples) {
console.log(example.turns[0].content) console.log(example[0].content)
} }
let msg = 'Examples of how to respond:\n'; let msg = 'Examples of how to respond:\n';
for (let i=0; i<selected_examples.length; i++) { for (let i=0; i<selected_examples.length; i++) {
let example = selected_examples[i]; let example = selected_examples[i];
msg += `Example ${i+1}:\n${stringifyTurns(example.turns)}\n\n`; msg += `Example ${i+1}:\n${stringifyTurns(example)}\n\n`;
} }
return msg; return msg;
} }

24
src/utils/keys.js Normal file
View file

@ -0,0 +1,24 @@
import { readFileSync } from 'fs';
let keys = {};
try {
const data = readFileSync('./keys.json', 'utf8');
keys = JSON.parse(data);
} catch (err) {
console.warn('keys.json not found. Defaulting to environment variables.'); // still works with local models
}
export function getKey(name) {
let key = keys[name];
if (!key) {
key = process.env[name];
}
if (!key) {
throw new Error(`API key "${name}" not found in keys.json or environment variables!`);
}
return keys[name];
}
export function hasKey(name) {
return keys[name] || process.env[name];
}

4
src/utils/mcdata.js
View file

@ -1,5 +1,5 @@
import minecraftData from 'minecraft-data'; import minecraftData from 'minecraft-data';
import settings from '../settings.js'; import settings from '../../settings.js';
import { createBot } from 'mineflayer'; import { createBot } from 'mineflayer';
import { pathfinder } from 'mineflayer-pathfinder'; import { pathfinder } from 'mineflayer-pathfinder';
import { plugin as pvp } from 'mineflayer-pvp'; import { plugin as pvp } from 'mineflayer-pvp';
@ -68,7 +68,7 @@ export function initBot(username) {
export function isHuntable(mob) { export function isHuntable(mob) {
if (!mob || !mob.name) return false; if (!mob || !mob.name) return false;
const animals = ['chicken', 'cod', 'cow', 'llama', 'mooshroom', 'pig', 'pufferfish', 'rabbit', 'salmon', 'sheep', 'squid', 'tropical_fish', 'turtle']; const animals = ['chicken', 'cow', 'llama', 'mooshroom', 'pig', 'rabbit', 'sheep'];
return animals.includes(mob.name.toLowerCase()) && !mob.metadata[16]; // metadata 16 is not baby return animals.includes(mob.name.toLowerCase()) && !mob.metadata[16]; // metadata 16 is not baby
} }

48
src/utils/text.js
View file

@ -12,3 +12,51 @@ export function stringifyTurns(turns) {
} }
return res.trim(); return res.trim();
} }
export function toSinglePrompt(turns, system=null, stop_seq='***', model_nickname='assistant') {
let prompt = system ? `${system}${stop_seq}` : '';
let role = '';
turns.forEach((message) => {
role = message.role;
if (role === 'assistant') role = model_nickname;
prompt += `${role}: ${message.content}${stop_seq}`;
});
if (role !== model_nickname) // if the last message was from the user/system, add a prompt for the model. otherwise, pretend we are extending the model's own message
prompt += model_nickname + ": ";
return prompt;
}
// ensures stricter turn order for anthropic/llama models
// combines repeated messages from the same role, separates repeat assistant messages with filler user messages
export function strictFormat(turns) {
let prev_role = null;
let messages = [];
let filler = {role: 'user', content: '_'};
for (let msg of turns) {
if (msg.role === 'system') {
msg.role = 'user';
msg.content = 'SYSTEM: ' + msg.content;
}
if (msg.role === prev_role && msg.role === 'assistant') {
// insert empty user message to separate assistant messages
messages.push(filler);
messages.push(msg);
}
else if (msg.role === prev_role) {
// combine new message with previous message instead of adding a new one
messages[messages.length-1].content += '\n' + msg.content;
}
else {
messages.push(msg);
}
prev_role = msg.role;
}
if (messages.length > 0 && messages[0].role !== 'user') {
messages.unshift(filler); // anthropic requires user message to start
}
if (messages.length === 0) {
messages.push(filler);
}
return messages;
}