Overview of VRChat MCP OSC and UBOS Asset Marketplace for MCP Servers

In the rapidly evolving landscape of virtual reality, the integration of AI technology is not just a trend but a necessity for creating immersive and interactive experiences. The VRChat MCP OSC is a cutting-edge solution that bridges the gap between AI assistants and VRChat, leveraging the Model Context Protocol (MCP) to enable AI-driven avatar control and interactions within virtual environments. This innovation is part of the broader UBOS Asset Marketplace for MCP Servers, which focuses on enhancing AI capabilities across various platforms.

Use Cases

1. Enhanced User Interaction: By using AI assistants like Claude, users can control avatar parameters, expressions, and movements, making the interaction more dynamic and personalized.
2. Seamless Communication: The ability to send messages and respond to VR events through AI assistants enhances the communication within the VRChat, making it more engaging and interactive.
3. Automation of Repetitive Tasks: Automating avatar movements and expressions can free users from repetitive tasks, allowing them to focus on more creative and engaging activities.
4. Improved Accessibility: For users with disabilities, AI-driven controls can provide an accessible way to interact with virtual environments.

Key Features

• Avatar Control: Manipulate avatar parameters and expressions to reflect emotions and actions in real-time.
• Movement Control: Direct avatar movement and orientation for a more lifelike experience.
• Communication: Send messages through VRChat’s chatbox, facilitating smooth communication between users.
• Menu Access: Toggle VRChat menu and interface elements effortlessly.
• Avatar Information: Query avatar properties and parameters for a deeper understanding of the virtual persona.
• Seamless VRChat Integration: Automatic detection of avatar configurations ensures smooth operation without manual adjustments.

System Requirements

To utilize the VRChat MCP OSC, certain system requirements must be met:

• Node.js 18 or higher
• VRChat with OSC enabled
• Claude Desktop with MCP support

Integration with UBOS Platform

UBOS is a full-stack AI Agent Development Platform dedicated to integrating AI Agents into every business department. By orchestrating AI Agents and connecting them with enterprise data, UBOS helps build custom AI Agents with LLM models and Multi-Agent Systems. The integration of VRChat MCP OSC within the UBOS Asset Marketplace exemplifies how AI can be seamlessly woven into various platforms, enhancing functionality and user experience.

Using with Claude Desktop

To get started with Claude Desktop, follow these steps:

1. Clone and npm link

   git clone https://github.com/Krekun/vrchat-mcp-osc
   cd vrchat-mcp-osc
   npm link
   

2. Configure Claude Desktop

   Edit the claude_desktop_config.json file to configure Claude Desktop:

   {
     "mcpServers": {
       "vrchat-mcp-osc": {
         "command": "npx",
         "args": ["vrchat-mcp-osc"]
       }
     }
   }
   

3. Command Line Options

   Customize the server using various command-line arguments:

   # Claude Desktop configuration
   {
     "mcpServers": {
       "vrchat-mcp-osc": {
         "command": "npx",
         "args": [
           "vrchat-mcp-osc",
           "--websocket-port", "8765",
           "--websocket-host", "localhost",
           "--osc-send-port", "9000",
           "--osc-send-ip", "127.0.0.1",
           "--osc-receive-port", "9001",
           "--osc-receive-ip", "127.0.0.1",
           "--debug"             
         ]
       }
     }
   }
   

Available MCP Tools

VRChat MCP OSC provides a range of tools to AI assistants:

• get_avatar_name: Retrieves the current avatar’s name.
• get_avatar_parameters: Lists available avatar parameters.
• set_avatar_parameter: Sets a specific avatar parameter.
• set_emote_parameter: Triggers avatar emotes.
• move_avatar: Moves the avatar in a specific direction.
• look_direction: Controls avatar’s view direction.
• jump: Makes the avatar jump.
• menu: Toggles the VRChat menu.
• voice: Toggles voice features.
• send_message: Sends a message to the VRChat chatbox.

Troubleshooting

Common Issues

1. VRChat not responding to commands

   • Ensure OSC is enabled in VRChat settings.
   • Check that the OSC ports match between VRChat and MCP configuration.
   • Restart VRChat and Claude Desktop.

2. MCP server not starting

   • Ensure Node.js 18+ is installed.
   • Check command line arguments for errors.
   • Try running with --debug flag for more detailed logs.

3. NPX execution issues

   • If arguments aren’t being recognized, try using the double dash format: npx vrchat-mcp-osc -- --debug.
   • On Windows, try running in a command prompt with administrator privileges.

Conclusion

The VRChat MCP OSC is a revolutionary tool for enhancing virtual reality interactions through AI-driven avatar control. By integrating seamlessly with the UBOS platform, it provides a robust solution for businesses and developers looking to harness the power of AI in virtual environments. Whether you’re aiming to improve user interaction, automate tasks, or enhance accessibility, the VRChat MCP OSC offers a comprehensive set of features to meet your needs.