Unity Setup and AI Integration

Welcome to the first lesson of our Unity + AI Prototype course! In this lesson, you'll set up your Unity development environment and learn how to integrate AI tools into your workflow for maximum productivity.

Project Overview: AI Dungeon Explorer

We'll be building "AI Dungeon Explorer" - a 3D dungeon crawler that demonstrates advanced AI integration techniques. This prototype will showcase procedural level generation, intelligent NPCs, and AI-driven game mechanics.

Step 1: Unity Project Setup

Creating the Project

1. Open Unity Hub and click "New Project"
2. Select "3D (Built-in Render Pipeline)" template
3. Name your project: "AI-Dungeon-Explorer"
4. Choose a location for your project files
5. Click "Create Project"

Project Configuration

Once your project opens, let's configure it for optimal AI-assisted development:

Package Manager Setup

1. Open Window → Package Manager
2. Install these packages:
   • TextMeshPro (for UI text)
   • Input System (for modern input handling)
   • Cinemachine (for camera control)
   • ProBuilder (for level design)

Project Settings

1. Edit → Project Settings
2. Player Settings:
   • Set Company Name: "YourStudio"
   • Set Product Name: "AI Dungeon Explorer"
   • Configure Icon and Splash Screen

Step 2: AI Tool Integration

Setting Up AI Game Builder

1. Open the AI Game Builder in your browser

2. Configure your API keys:

   • OpenAI API key (for GPT-4)
   • Anthropic API key (for Claude)
   • DeepSeek API key (for cost-effective alternatives)

3. Test your setup with a simple prompt:

   Generate a C# script for a basic player controller in Unity

AI-Assisted Code Generation

Let's create our first AI-generated script:

Player Controller Script

Use this prompt in your AI Game Builder:

Create a Unity C# script for a 3D first-person player controller with these features:
- WASD movement with mouse look
- Jump functionality with gravity
- Ground detection
- Smooth camera movement
- Configurable movement speed and mouse sensitivity
- Include proper documentation and comments

Camera Controller Script

Generate a camera controller:

Create a Unity C# script for a third-person camera controller that:
- Follows a target object smoothly
- Allows mouse input for camera rotation
- Has configurable follow distance and height
- Includes collision detection to prevent clipping
- Has smooth transitions and damping

Step 3: Project Structure and Organization

Folder Organization

Create this folder structure in your Unity project:

Assets/
├── Scripts/
│   ├── Player/
│   ├── AI/
│   ├── Level/
│   └── UI/
├── Prefabs/
│   ├── Player/
│   ├── NPCs/
│   └── Environment/
├── Materials/
├── Textures/
├── Audio/
└── Scenes/
    ├── MainMenu
    ├── Game
    └── Test

Version Control Setup

1. Initialize Git repository:

   git init
   git add .
   git commit -m "Initial Unity project setup"

2. Create .gitignore for Unity:

   [Ll]ibrary/
   [Tt]emp/
   [Oo]bj/
   [Bb]uild/
   [Bb]uilds/
   [Ll]ogs/
   [Uu]ser[Ss]ettings/
   *.tmp
   *.user
   *.userprefs
   *.pidb
   *.booproj
   *.svd
   *.pdb
   *.mdb
   *.opendb
   *.VC.db

Step 4: AI-Powered Development Workflow

Code Generation Best Practices

Effective Prompting for Unity

When generating Unity code, include these details:

1. Specific Unity version: "Unity 2022.3 LTS"
2. Target platform: "PC/Mac standalone"
3. Performance requirements: "Optimized for 60fps"
4. Code style: "Clean, documented, production-ready"

Example Prompt Structure

Create a Unity C# script for [specific functionality] that:
- Works with Unity [version]
- Targets [platform]
- Includes [specific features]
- Has [performance requirements]
- Follows [coding standards]
- Includes [documentation level]

AI-Assisted Asset Creation

Level Design with AI

Use AI to generate level concepts:

Design a dungeon level for a 3D game with these requirements:
- Size: 20x20 units
- Theme: Ancient temple
- Features: 3 rooms, 2 corridors, 1 secret area
- Hazards: Traps, puzzles, enemies
- Objectives: Find 3 keys, defeat boss, escape
- Include specific measurements and layout details

NPC Design with AI

Generate character concepts:

Create an NPC for a dungeon crawler game:
- Role: Shopkeeper/merchant
- Personality: Mysterious, helpful but cryptic
- Appearance: Detailed description
- Dialogue: 5-7 lines of conversation
- Function: Sells items, provides hints
- Location: Hidden room in dungeon

Step 5: Development Environment Optimization

IDE Configuration

Visual Studio Setup

1. Install Visual Studio 2022 with Unity workload
2. Configure Unity integration:
   • Tools → Options → Unity → External Tools
   • Set External Script Editor to Visual Studio

VS Code Alternative

If using VS Code:

1. Install C# extension
2. Install Unity extension
3. Configure Unity integration

AI Code Assistant Setup

GitHub Copilot Integration

1. Install GitHub Copilot in your IDE
2. Configure for Unity development
3. Test with simple C# scripts

Cursor AI Integration

1. Install Cursor (AI-powered code editor)
2. Configure Unity project
3. Test AI-assisted coding

Step 6: First AI-Generated Scripts

Player Movement System

Let's create our first AI-generated script:

using UnityEngine;

[RequireComponent(typeof(CharacterController))]
public class PlayerController : MonoBehaviour
{
    [Header("Movement Settings")]
    public float walkSpeed = 5f;
    public float runSpeed = 8f;
    public float jumpSpeed = 8f;
    public float gravity = 20f;

    [Header("Mouse Look Settings")]
    public float mouseSensitivity = 2f;
    public float upDownRange = 60f;

    private CharacterController characterController;
    private Camera playerCamera;
    private Vector3 moveDirection = Vector3.zero;
    private float verticalRotation = 0;
    private bool isRunning = false;

    void Start()
    {
        characterController = GetComponent<CharacterController>();
        playerCamera = GetComponentInChildren<Camera>();

        // Lock cursor to center of screen
        Cursor.lockState = CursorLockMode.Locked;
    }

    void Update()
    {
        HandleMouseLook();
        HandleMovement();
        HandleJump();
    }

    void HandleMouseLook()
    {
        float mouseX = Input.GetAxis("Mouse X") * mouseSensitivity;
        float mouseY = Input.GetAxis("Mouse Y") * mouseSensitivity;

        // Rotate the player body left and right
        transform.Rotate(0, mouseX, 0);

        // Rotate the camera up and down
        verticalRotation -= mouseY;
        verticalRotation = Mathf.Clamp(verticalRotation, -upDownRange, upDownRange);
        playerCamera.transform.localRotation = Quaternion.Euler(verticalRotation, 0, 0);
    }

    void HandleMovement()
    {
        float horizontal = Input.GetAxis("Horizontal");
        float vertical = Input.GetAxis("Vertical");

        isRunning = Input.GetKey(KeyCode.LeftShift);
        float currentSpeed = isRunning ? runSpeed : walkSpeed;

        Vector3 forward = transform.TransformDirection(Vector3.forward);
        Vector3 right = transform.TransformDirection(Vector3.right);

        float curSpeedX = currentSpeed * vertical;
        float curSpeedY = currentSpeed * horizontal;

        moveDirection = (forward * curSpeedX) + (right * curSpeedY);
    }

    void HandleJump()
    {
        if (characterController.isGrounded)
        {
            if (Input.GetButton("Jump"))
            {
                moveDirection.y = jumpSpeed;
            }
        }

        moveDirection.y -= gravity * Time.deltaTime;
        characterController.Move(moveDirection * Time.deltaTime);
    }
}

Camera Controller

using UnityEngine;

public class CameraController : MonoBehaviour
{
    [Header("Target Settings")]
    public Transform target;
    public Vector3 offset = new Vector3(0, 5, -10);

    [Header("Follow Settings")]
    public float followSpeed = 10f;
    public float rotationSpeed = 5f;

    [Header("Mouse Look Settings")]
    public float mouseSensitivity = 2f;
    public float upDownRange = 60f;

    private float verticalRotation = 0;
    private float horizontalRotation = 0;

    void Start()
    {
        if (target == null)
        {
            target = GameObject.FindGameObjectWithTag("Player").transform;
        }

        // Lock cursor to center of screen
        Cursor.lockState = CursorLockMode.Locked;
    }

    void LateUpdate()
    {
        if (target == null) return;

        HandleMouseLook();
        FollowTarget();
    }

    void HandleMouseLook()
    {
        float mouseX = Input.GetAxis("Mouse X") * mouseSensitivity;
        float mouseY = Input.GetAxis("Mouse Y") * mouseSensitivity;

        horizontalRotation += mouseX;
        verticalRotation -= mouseY;
        verticalRotation = Mathf.Clamp(verticalRotation, -upDownRange, upDownRange);
    }

    void FollowTarget()
    {
        // Calculate desired position
        Vector3 desiredPosition = target.position + target.TransformDirection(offset);

        // Smooth follow
        transform.position = Vector3.Lerp(transform.position, desiredPosition, followSpeed * Time.deltaTime);

        // Look at target with mouse rotation
        Vector3 lookDirection = target.position - transform.position;
        lookDirection = Quaternion.Euler(verticalRotation, horizontalRotation, 0) * Vector3.forward;

        transform.rotation = Quaternion.LookRotation(lookDirection);
    }
}

Step 7: Testing and Validation

Scene Setup

1. Create a new scene: File → New Scene
2. Add a ground plane: GameObject → 3D Object → Plane
3. Add the player: Create empty GameObject, add PlayerController script
4. Add camera: Create empty GameObject, add CameraController script
5. Test the setup: Play the scene and verify movement works

AI-Assisted Debugging

If you encounter issues, use AI to help debug:

I'm having trouble with my Unity player controller. The character moves but the camera doesn't follow properly. The camera script is attached to a separate GameObject and should follow the player. What could be wrong?

Next Steps

In the next lesson, you'll learn AI-Powered Level Generation - how to create procedural dungeons using AI assistance.

Key Takeaways

• Proper Unity project setup is essential for AI-assisted development
• AI tools can generate production-ready Unity scripts
• Effective prompting requires specific Unity context
• Version control is crucial for AI-generated code management

Resources for Further Learning

• Unity Documentation
• AI Game Builder - Practice AI-assisted coding
• Community Forums - Get help with Unity + AI integration

Ready to create AI-generated levels? Let's move on to Lesson 2: AI-Powered Level Generation!