Feature: add JSON export of chat prompt logs in chat debug view

[zhichli]

Add a new feature to allow exporting logs of individual chat prompt node or all nodes in the copilot debug view in JSON.

Usage:

• offline evaluation and trajectory transformation
• dependency of WIP chat replay feature

[connor4312]

Looks sane overall, some suggestions

[connor4312]

This notification is extraneous since we show the file after we save it anyway, I would avoid the extra noise

Suggested change

	const result = await vscode.window.showInformationMessage(
	`Successfully exported prompt with ${promptObject.logCount} log entries to ${saveUri.fsPath}`,
	revealAction,
	openAction
	);

[zhichli]

I'm not sure which code you mean that does the "show the file after we save". Without this notification, there is no feedback in ui whether the file is saved or where to find it. I also think real action is useful besides openaction.

[connor4312]

Oh, I suppose only if result === revealAction or openAction. We could display the notification only if it's not one of those

[zhichli]

are you assuming the file is auto-opened after the vscode.workspace.fs.writeFile call ? As tested, the current ux is when the user clicks the export as json button, it will write/save the file under the scene and won't open the file saved, then the notification comes in as the only way to render those 2 actions user can subsequently take (including open and see the file). So I'm still confused here in what scenarios we don't need to show notification 🥲 - pardon me if I misunderstood anything.

[connor4312]

Similarly here

Suggested change

	const result = await vscode.window.showInformationMessage(
	`Successfully exported ${allPromptsContent.length} prompts with ${totalLogEntries} log entries to ${saveUri.fsPath}`,
	revealAction,
	openAction
	);