2026-02-14 14:07:33.3208 | System | Loading configuration...
2026-02-14 14:07:33.5173 | System | Configuration loaded successfully.
2026-02-14 14:07:33.5177 | System | Retrieving configuration model...
2026-02-14 14:07:33.5704 | System | Configuration model retrieved successfully.
2026-02-14 14:07:33.5708 | System | Setting up DefaultAzureCredential...
2026-02-14 14:07:33.7542 | System | DefaultAzureCredential setup completed.
2026-02-14 14:07:33.7546 | System | Configuring SecretClient...
2026-02-14 14:07:33.7603 | System | Secret Client configured successfully.
2026-02-14 14:07:33.7614 | System | Initializing Persistent Agents Client...
2026-02-14 14:07:33.7684 | System | Persistent Agents Client initialized successfully.
2026-02-14 14:07:33.7688 | System | Choose an option:
2026-02-14 14:07:33.7690 | System | 1 - Evaluate Agents
2026-02-14 14:07:33.7692 | System | 2 - Evaluate Multi Agents
2026-02-14 14:07:33.7693 | System | 3 - Evaluate Human-in-the-loop Orchestration Workflows
2026-02-14 14:07:33.7695 | System | 4 - Evaluate Sequantial Orchestration Workflows
2026-02-14 14:07:33.7696 | System | 5 - Generate CSVs
2026-02-14 14:07:33.7697 | System | 6 - Exit
2026-02-14 14:07:33.7698 | System | Enter choice (1/2/3/4/5/6): 2026-02-14 14:07:37.2700 | System | Evaluating Human-in-the-Loop Workflow
2026-02-14 14:07:37.2996 | Test | Evaluating An orchestrator agent with digital twin agent, guideline agent and plan agent. using Tests\Workflow\wf-test-b-4-2.json.
2026-02-14 14:07:37.3935 | Test | Loaded 21 prompts from JSON file.
2026-02-14 14:07:37.3944 | Test | Creating Sub Persistent Agent: DigitalTwinAgent...
2026-02-14 14:07:37.3946 | Test | Retrieving secret from Key Vault...
2026-02-14 14:07:39.4574 | Test | Creating ClientSecretCredential...
2026-02-14 14:07:39.4583 | Test | Validating scope...
2026-02-14 14:07:39.4586 | Test | Requesting access token...
2026-02-14 14:07:40.0525 | Test | Defining MCP Tool...
2026-02-14 14:07:40.0542 | Test | Creating Sub Persistent Agent...
2026-02-14 14:07:50.0564 | Test | Sub Persistent Agent Id: asst_K2rK76AbBeF4RSilJFZS2iC4 Name: DigitalTwinAgent Model: gpt-4o
2026-02-14 14:07:50.0567 | Test | Defining Handle Digital Twin realted tasks using their digital twin id.
2026-02-14 14:07:50.0570 | Test | Adding Sub Persistent Agent to Connected Agent Tool Definition List...
2026-02-14 14:07:50.0571 | Test | Configuring MCP Tool Resource...
2026-02-14 14:07:50.0585 | Test | Creating Sub Persistent Agent: GuidelineAgent...
2026-02-14 14:07:50.0587 | Test | Retrieving secret from Key Vault...
2026-02-14 14:07:50.1144 | Test | Creating ClientSecretCredential...
2026-02-14 14:07:50.1147 | Test | Validating scope...
2026-02-14 14:07:50.1154 | Test | Requesting access token...
2026-02-14 14:07:50.2284 | Test | Defining MCP Tool...
2026-02-14 14:07:50.2303 | Test | Creating Sub Persistent Agent...
2026-02-14 14:07:50.4865 | Test | Sub Persistent Agent Id: asst_6toowcLDX0i9jX9mlVJqeh0f Name: GuidelineAgent Model: gpt-4o
2026-02-14 14:07:50.4880 | Test | Defining Provide guidelines and best practices.
2026-02-14 14:07:50.4881 | Test | Adding Sub Persistent Agent to Connected Agent Tool Definition List...
2026-02-14 14:07:50.4882 | Test | Configuring MCP Tool Resource...
2026-02-14 14:07:50.4883 | Test | Creating Sub Persistent Agent: PlanAgent...
2026-02-14 14:07:50.4884 | Test | Retrieving secret from Key Vault...
2026-02-14 14:07:50.5455 | Test | Creating ClientSecretCredential...
2026-02-14 14:07:50.5457 | Test | Validating scope...
2026-02-14 14:07:50.5459 | Test | Requesting access token...
2026-02-14 14:07:50.7006 | Test | Defining MCP Tool...
2026-02-14 14:07:50.7018 | Test | Creating Sub Persistent Agent...
2026-02-14 14:07:50.9395 | Test | Sub Persistent Agent Id: asst_sPcibrf700cOwa0SEg26vMFX Name: PlanAgent Model: gpt-4o
2026-02-14 14:07:50.9410 | Test | Defining Create action plans based on the context provided.
2026-02-14 14:07:50.9416 | Test | Adding Sub Persistent Agent to Connected Agent Tool Definition List...
2026-02-14 14:07:50.9428 | Test | Configuring MCP Tool Resource...
2026-02-14 14:07:50.9434 | Test | Creating Main Persistent Agent...
2026-02-14 14:07:51.1329 | Test | Main Persistent Agent Id: asst_kwneiPfLyU8CUdogaoZ1Zq6b Name: MainAgent Model: gpt-4o
2026-02-14 14:07:51.1347 | Test | Creating Persistent Agent Thread...
2026-02-14 14:07:51.3790 | Test | Persistent Agent Thread Id: thread_RsUfOHFXUU90nE1or6qwrtrV
2026-02-14 14:07:51.3816 | Test | An orchestrator agent with digital twin agent, guideline agent and plan agent. chat started. Type 'exit' to quit.
2026-02-14 14:07:51:3819 | User | 2026-02-14 14:07:51.7553 | Test | No user input received. Using prompt from the test file at index 0.
2026-02-14 14:07:51:7556 | Test | using guideline agent, delete guideline g1.
2026-02-14 14:07:51.7558 | Agent | Sending test message to Main Persistent Agent...
2026-02-14 14:07:52.0126 | Agent | Creating thread run...
2026-02-14 14:07:52.6284 | Agent | Thread run created with Id: run_EaNK28Cw53zabvL8DJadguW3. Monitoring run status...
2026-02-14 14:07:53.3371 | Agent | Last Run Step: message_creation Status: in_progress CreatedAt: 14/02/2026 14:07:53 +00:00
2026-02-14 14:07:53.5537 | Agent | No annotations
2026-02-14 14:07:53.9812 | Agent | Last Run Step: message_creation Status: completed CreatedAt: 14/02/2026 14:07:53 +00:00
2026-02-14 14:07:54.1810 | Agent | No annotations
2026-02-14 14:07:54.1815 | Agent | Retrieving messages from Main Persistent Agent...
2026-02-14 14:07:54.3825 | Agent | I can't assist with deleting guidelines. If you need help with something else related to guidelines, feel free to ask!
2026-02-14 14:07:54:3835 | User | 