Copilot Enterprise - Feedback

[arfon]

• Who: Customers using Copilot Enterprise.
• What: We want to hear from you! Provide feedback on the Copilot Enterprise in this Discussion

---

---

As of 27th February 2024, GitHub Copilot Enterprise is now generally available 🚀. Read more about Copilot Enterprise on our recent blog post.

This thread is just for product feedback.

We are responding to general Questions & Answers related to Copilot Enterprise in another discussion: Copilot Enterprise Q & A

[mattbrandman]

Would love to be able to bulk index repositories as it seems to hang while indexing is happening. It is also unclear if a chat works without indexing the repo first as well.

[arfon]

Thanks for the feedback @mattbrandman. Could you say more about what is 'hanging' when indexing?

It is also unclear if a chat works without indexing the repo first as well.

Chat will still work, it's just the scenarios that connect natural language questions like 'where does authentication happen' to underlying code won't work.

[arfon]

/ cc @colinwm

[RealEstateSaga]

How are you? If I delete this, will my site crash, or is this just for search engines?

/next-sitemap.config.js

Sorry, I am just in a little bit of bind, Google My business does not like something on it, and they emailed me about fixing it.

Thanks!

[syossan27]

When I type Japanese in Copilot chat, the message is sent when I press the enter key after conversion.
I am having trouble typing sentences in Japanese if this is not corrected.
Please check the attached video.

feedback.mov

[arfon]

Thanks @syossan27 – we've noticed this issue too and are working on a fix.

[arfon]

This should be fixed now, would love to hear back if you're still facing issues?

[ChrisAveniq]

I have noticed two issues:

• When using chat in our indexed repository, it does not seem to know about directories that are clearly there. It says it does not exist.
  It says: I'm sorry, but I couldn't find any content in the "ingress" folder in the "xxx/reponame" repository. It's possible that the folder doesn't exist, is empty, or is not publicly accessible. Please verify the folder name and its accessibility.

But the repo has a folder named "ingress" in the root. The repo is internal, however.

• and this is also weird:
  

[arfon]

Got it. Thanks. And just confirming that the repository is showing up as indexed when you open up a chat session?

[ChrisAveniq]

@arfon Yes: Indexed for improved understanding and accuracy.

[OneCyrus]

@arfon it seems to be really hard to get a response at all which is related to the index.

[arfon]

I think you've identified a good gap in Copilot's capabilities here. Currently Copilot knows how to do the following four things:

• show-symbol-definition: To retrieve the lines of code that define a code symbol from a specified repository's checked in git files. This function is used when we have an exact symbol name to query with.
• pathsearch: To retrieve a file from a repository's git checked in files that matches the filename or file path provided. This function is used when the exact filename or file path to a file checked in to the repository is provided.
• bing-search: To search the web using the Bing search engine. This function is used when the user's query pertains to recent events, information that is frequently updated, new developments, trends, technologies, or is extremely specific or detailed.
  codesearch: To search code within a specified repository's git checked in files. This function is used when a user asks questions related to the repository's code, such as where or how certain functionality has been implemented.

(you can ask Copilot about this too)

What you're asking Copilot to do here is related to the various code search scenarios, but isn't quite right (as you say, you want a count/list from the index).

It's certainly possible to teach Copilot how to do this kind of thing and we'll put it on our backlog for sure. Can you say more about what you're wanting from Copilot in this kind of scenario? Is it a better understanding of what the 'shape' of a repository is, or were you looking for particular content?

[kokuyouwind]

It's certainly possible to teach Copilot how to do this kind of thing and we'll put it on our backlog for sure. Can you say more about what you're wanting from Copilot in this kind of scenario? Is it a better understanding of what the 'shape' of a repository is, or were you looking for particular content?

In my case, I encountered both.

The former use is a mono-repo asking for a description under a specific directory or asking for a use under a specific directory.
For example, the question "What is under the server directory?" will receive the answer "I'm sorry, but I couldn't find any information about a 'server' directory in the 'xxx' repository."
If I changed the question to "What framework is used under the server directory?", I could get answers such as Rails or Next.js. However, what I wanted with the original question was something a bit more abstract, such as "This is a client SPA for an API in the server directory."

The latter is a case where you want to find code under a specific directory or get the diff of multiple files that are close in usage.
For example, the questions "Is there a Google client under the server/app/gateways directory?" or "What are the differences in specifications for each client under the server/app/gateways directory?" will receive the answer "I'm sorry, but I couldn't find specific files under the server/app/ gateways directory in the xxx repository."

[ChrisAveniq]

I think what is missing is, similar to other copilots and chats, a stop button to stop a response. Sometimes it goes on for quite a long time and I already know I need to change my prompt.

[arfon]

Great suggestion, I agree this is a missing feature. We've added this to the backlog ✅

[PaulDMendoza]

For the browser chat tool:

My code base is 99% of C# but when I asked it to generate a unit text example it generated it in python. I think I need to provide some base level instructions to all the chats with some basic information. For example, I have created a custom Chat in ChatGPT that has the following instruction.

"My code base uses C# and we use Postgresql for our database server. We use Entity Framework for our simple data access. We use dependency injection. To get a connection to the database use ITeamDBConnection and to get an EntityFramework context use ITeamDBContextFactory and then call GetAsync()..."

This would really help the chat tool to improve the initial responses.

[arfon]

Hi @PaulDMendoza – this is great feedback, thank you.

My code base is 99% of C# but when I asked it to generate a unit text example it generated it in python. I think I need to provide some base level instructions to all the chats with some basic information. For example, I have created a custom Chat in ChatGPT that has the following instruction.

Yeah, this is a great idea, and we already do something similar with Copilot, but crucially we don't currently tell Copilot what programming languages are used in a repository. Doing this seems like a 'no-brainer' and I'll put this on the backlog!

[tristanbes]

There's few question I would like to have answers (right now the AI says it can't help):

Team / developpers related

• who are the top contributors of the past XX days ?
• what are the team working on right now (expecting results of a list of recent active PR with a short summary)
• what PR should require my attention ?

Code / Data / Analysis

• what are the most recurring fixes ?
• find the most updated file in the project
• how many unit tests there is in the project ?
• how many cypress scenarios we have ?
• can you give the % of failed github actions for the past 10 days ?

Lack of exhaustivity

• Find all events we're sending to our CDP -> while having 100+ events, the AI only gave 5 events (and said it wasn't exhaustive)

Screenshot

[timrogers]

Thanks for sharing these examples @tristanbes! They are super useful.

To be completely transparent, these are not the kinds of questions that Copilot Chat is able to answer right now - but we are working to fill these gaps and make Copilot better. Your examples are really valuable to help us prioritise.

We'll also look at how we can help you and other developers to understand what Copilot is good at and what it isn't good at - we don't do that very well right now.

[ghost]

I have transitioned to the enterprise version so that the Copilot chat will understand the context of the entire project. Thus, I won't need to explain that this file does X and that file does Y, or that I need to paste the code for it to understand which file does what. I had assumed that with the enterprise version, it would scan the repositories, and when I talk about a specific file, it would understand what I am referring to. However, it does not. I have configured the policies and created a knowledge base, but it did not change anything.

Bottom line:
I want the copilot to scan the entire repository be aware of all the files and the code inside and answer the questions in the context of the entire project.
here is example
I had issues with CSS that share the same name inside the project I want the copilot be aware of it and let me know that I need to change the names or when it recommend code or css to write it in the context of a project and not just as an example

[timrogers]

Hi Eran! I'm sorry to hear that you're having a frustrating experience. A couple of questions:

1. Are you using Copilot Chat on github.com, or in your IDE? If so, which IDE are you using?
2. Can you share some examples of the kinds of questions you're asking? If you're not comfortable sharing here, feel free to email me at the @github.com email on my profile.

[emartin-monterey]

We are testing out Git Hub Enterprise & Copilot Enterprise for some of the same reasons and have similar questions. Local Visual Studio Pro Copilot Enterprise subscription Chat & Completion extensions do not seem to be aware if the indexed repos. Is there some other aspect to configure, etc. where this works locally?

For example, a Copilot Web chat prompt of "Use the Collector repo to find examples of Jobs and then create a Job that reads all the files in a given directory" provides a reasonable response of "..., class ReadDirectoryFilesJob : AbstractJob ..." with appropriate use of the AbstractJob class including the class method entry point which is the kind of functionality we are looking for.

On the other hand, locally the Visual Studio Pro Copilot Enterprise subscription chat for the same prompt returns "I'm sorry for the confusion, but as an AI, I don't have the ability to access or search through repositories, including the Collector repo". In addition, Copilot Enterprise subscription Completions VS Pro extension can not comprehend this directive without a number of related repo files open locally.

Note that we have not added any information to the repo's knowledge base. I will also note that the local Copilot extension does not have the ability to use the Bing search tool.

[arfon]

Thanks for the detailed feedback @emartin-monterey. It's possible that the (GitHub) Copilot Extension in Visual Studio Pro needs some configuration/setup here. I'm checking with the team to find out what might be the issue.

[emartin-monterey]

I posed this same question to GitHub Enterprise support and their response was:

"I was just informed by engineering that this feature is not available yet outside of github.com. They are working to have this feature available for Visual Studio soon. I recommend you keep an eye on the GitHub Blog and our social media feeds for the latest announcements about new features and fixes.
You can also check out our Public roadmap to see what we're currently working on."

Looking at the public roadmap linked and even the backlog, Copilot is not mentioned and nothing related seems to be slotted for this year so far, which tells me this capability is not really on the radar. Paying $39 a user for the Copilot "chat with your code" feature, on top of the regular GitHub Enterprise subscription fee, is certainly less of a value-add than what we envisioned when upgrading to the Enterprise subscription.

[ghost]

Hey Tim,

I'm absolutely enamored with GitHub Copilot Chat. It writes nearly all of my code and consistently helps me debug and brainstorm new ideas. It's truly the most powerful tool I've ever used; I love it.

The only issue is that you always have to paste the code into it so it can grasp the context of your question. Even if I open the file and it appears in the editor, it seems to "read" it as if the chat is open on the left and the code is open on the right, and it still doesn't fully understand the context of the question.

I was hoping that the enterprise edition would grant the tool access to the entire repository, eliminating the need to copy the code for the initial question on a specific file. Unfortunately, it appears that for now, it's limited. I can inquire about a specific file if I provide the path, but this isn't conducive to seamless back-and-forth conversations.

I want to be able to chat with it and have it precisely understand what I'm talking about in the context of the repository.
I hope it helps.
Eran

[arfon]

I was hoping that the enterprise edition would grant the tool access to the entire repository, eliminating the need to copy the code for the initial question on a specific file. Unfortunately, it appears that for now, it's limited. I can inquire about a specific file if I provide the path, but this isn't conducive to seamless back-and-forth conversations.

@erangross – are you specifically looking for Copilot to have this additional 'repository-wide context' in the IDE chat sessions?

[stvnwrgs]

@arfon This would be huge! Biggest missing feature IMO!

[ghost]

From: Arfon Smith ***@***.***> Sent: Friday, March 1, 2024 2:03 PM To: community/community‏ ***@***.***> Cc: Eran Gross‏ ***@***.***>; Mention‏ ***@***.***> Subject: Re: [community/community] Copilot Enterprise - Feedback (Discussion #110314) I was hoping that the enterprise edition would grant the tool access to the entire repository, eliminating the need to copy the code for the initial question on a specific file. Unfortunately, it appears that for now, it's limited. I can inquire about a specific file if I provide the path, but this isn't conducive to seamless back-and-forth conversations. @erangross<https://github.com/erangross> – are you specifically looking for Copilot to have this additional 'repository-wide context' in the IDE chat sessions? Exactly. 'repository-wide context' in the IDE chat sessions I could not phrase it better myself. Eran — Reply to this email directly, view it on GitHub<#110314 (reply in thread)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AMRPK2CQVSL5EJXBFXYAISLYWBU5ZAVCNFSM6AAAAABD4MYPTKVHI2DSMVQWIX3LMV43SRDJONRXK43TNFXW4Q3PNVWWK3TUHM4DMNBSGM2DS>. You are receiving this because you were mentioned.Message ID: ***@***.******@***.***>>

[arfon]

@erangross – are you familiar with the @workspace command in VS Code: https://code.visualstudio.com/updates/v1_84#_workspace

[neo-cheung]

The knowledge base can support indexing issues, wikis, discussions, and PRs. It would be nice, since my organization uses issues and discussions for design documents and specifications.

[arfon]

Great suggestions, thanks @neo-cheung .

[YusukeKokubo]

I would be very happy for my organization if this is supported 🙏

[kokuyouwind]

I would like to have the option to specify the output language when generating the Pull Request Summary.
In Copilot Chat, inquiries in Japanese are answered in Japanese, but the Pull Request Summary is always generated in English, so a separate translation is required.

[arfon]

Great suggestion, thanks @kokuyouwind. Out of interest, would this be a preference for you (i.e., is it only you that speaks Japanese, or your team, or your whole organization)?

[kokuyouwind]

@arfon
The whole organization. Since I am Japanese working for a Japanese company and almost all of my colleagues are Japanese, I always write the Description of Pull Requests in my organization in Japanese.

[arfon]

Got it. Thanks @kokuyouwind - that makes a lot of sense!

[seanemmer]

Nice work! Very excited about this.

It appears that the VSCode version of Copilot Chat does not have access to the index that is generated for the github.com Copilot chat.

I have attempted to use the @workspace directive but don't get the same results (it doesn't generate references to the correct files).

[seanemmer]

Thanks for the quick reply and additional info!

I've done some further testing and both github.com and VSCode IDE @workspace seem to be behaving similarly.

The issue is they both have trouble referencing my schema.prisma file. They seem to prefer to referencing .ts files.

e.g. the prompt @workspace what fields are in the account model in schema.prisma

only returns references to .ts files, not schema.prisma. This is for both versions of Copilot.

[timrogers]

@seanemmer That's interesting! My guess is that this is something to do with the file being a .prisma file. On Copilot Chat on github.com, can you confirm what question you're asking? Do you get any little indicators like this in the response, or nothing?

[seanemmer]

Even more interesting. Here's a sample prompt:

But the reference is not to our schema.prisma, it's to the schema.prisma in a public repo:

https://github.com/Airbotics/uptane-server/blob/3ffe8ffb58e4ea19ed0bb724a07ea798dc0348ff/src/prisma/schema.prisma#L164-L278

[timrogers]

Even stranger! Just to confirm, did you get that answer without navigating to that public repo?

Did you take that screenshot immediately after getting the answer, or was there any kind of page refresh in between?

It is possible that Copilot could run a search including files outside of your repository - and that search could include public repositories - but I'm surprised not to see an indicator showing the search that was run, like in my screenshot above.

[seanemmer]

No page refresh, I'd never been to that repo.

It's no longer replicating today. Now both github.com and vscode correctly references my schema.prisma file! Not sure if you changed anything on your end.

github.com correctly refers to all of the fields on the Account model. Vscode still fails in answering the question despite having a reference to schema.prisma:

The Account model in your schema.prisma file is not directly provided in the excerpts you've shared. However, there are references to an Account model in the relations of other models. For example, in the[redacted] model, there's a relation to Account:

This suggests that there is an Account model in your schema, but without the direct excerpt of the Account model, I can't provide the exact fields in it.

[PaulDMendoza]

Are there release notes somewhere that we can see what has been updated with Copilot Enterprise Chat or somewhere we can track the improvements?

[timrogers]

Great question! We'll update the GitHub Changelog (which shows on your GitHub homepage) when we ship new improvements to Copilot 😊

[yanskun]

Depending on the GitHub color theme, the code is buried in the code block background color, so you can't see anything, which is very disappointing.

Can I change the color of codeblock?

[arfon]

Thanks for reporting this @yanskun - I've filed a bug with the team to look into this!

[arfon]

Hi @yanskun – we've been trying to replicated this issue but have so far failed. Can you share with me a little more detail:

• What browser are you using?
• Do you have an extensions enabled? If so, do you still see this issue with them disabled?

[yanskun]

@arfon
Thank you
When I was turning on/off various extensions, I realized that they were not compatible with Sourcegraph..!

[arfon]

Ah, so just to confirm, disabling the Sourcegraph extension fixed the issue for you?

[yanskun]

@arfon
Sorry,
Yes, I disabled it and it was resolved.

[ouweiya]

Is it currently not supported to use the knowledge base in VSCode? I saw in the YouTube video demonstration that the @docs directive is supported?

https://youtu.be/AAT4zCfzsHI?t=2287

[arfon]

Hi @ouweiya – I'm afraid this isn't shipped just yet, but it is being actively worked!

[github-actions[bot]]

💬 Your Product Feedback Has Been Submitted 🎉

Thank you for taking the time to share your insights with us! Your feedback is invaluable as we build a better GitHub experience for all our users.

Here's what you can expect moving forward ⏩

• Your input will be carefully reviewed and cataloged by members of our product teams. 
  • Due to the high volume of submissions, we may not always be able to provide individual responses.
  • Rest assured, your feedback will help chart our course for product improvements.
• Other users may engage with your post, sharing their own perspectives or experiences. 
• GitHub staff may reach out for further clarification or insight. 
  • We may 'Answer' your discussion if there is a current solution, workaround, or roadmap/changelog post related to the feedback.

Where to look to see what's shipping 👀

• Read the Changelog for real-time updates on the latest GitHub features, enhancements, and calls for feedback.
• Explore our Product Roadmap, which details upcoming major releases and initiatives.

What you can do in the meantime 💻

• Upvote and comment on other user feedback Discussions that resonate with you.
• Add more information at any point! Useful details include: use cases, relevant labels, desired outcomes, and any accompanying screenshots.

As a member of the GitHub community, your participation is essential. While we can't promise that every suggestion will be implemented, we want to emphasize that your feedback is instrumental in guiding our decisions and priorities.

Thank you once again for your contribution to making GitHub even better! We're grateful for your ongoing support and collaboration in shaping the future of our platform. ⭐

[emartin-monterey]

My group has been using Copilot Enterprise with indexed repos in Visual Studio Pro for a few months now and here are some thoughts:

It was unexpected that Copilot in the IDE does not have access to the private Enterprise-based repositories, I would be good to know what GitHub's plans/timelines are for integrating this feature into the IDE chat/completion:
https://github.com/orgs/community/discussions/110314#discussioncomment-9580572
Having this capability integrated in the IDE vs "ask on the web, copy to IDE, merge code" would ramp up productivity quite a bit.

Integrate the Copilot completion extension and Copilot chat extension so the completion extension has the context of the current thread selected in the Chat extension UI - these two plugins do not seem to share any context

Provide a Chat "system message" per chat thread which allows the developer to provide detailed context about the feature being worked on and how chat should respond, like "I am creating file management options for this application", and "Always show complete code suggestions, never '// ... ' ", etc. -

Provide a Chat "curated context" window option where the chat responses can be curated by the developer to remove noisy responses or bad prompts from the context - ChatGPT kind of does this with the pencil icon, however, a more fine-grained ability to remove parts of a prompt/response would be more beneficial

Selecting a code block/method and asking Copilot inline to document does not work very well - it can create basic method-level comments, but does not doc within the method or s selected code block within a method very often

Have the ability to point chat to a third-party index (Vector DB?) of a code repository - we have some Azure Git repositories that we will not move, but would be useful Copilot references during coding

Provide a Copilot Chat extension plugin mechanism (maybe this is Copilot Extensions, but a private version?) where Chat can use a custom "tool" to perform an action like query a DB that has a proprietary schema or do a search specific to internal systems - this would allow Copilot to be aware if things like DB schemas, configuration, Wikis, or other items

There has been at least one instance where Copilot documentation was not correct/updated which I think has added further confusion for our use in Visual Studio Pro, so having a complete review/update of these docs with the latest version capabilities would be helpful as well as updates for hits/tips:
https://github.com/orgs/community/discussions/123418

We have not had success in generating reasonable check-in comments in the IDE and we need more information on how/where this works - give Copilot the ability to compare changed files in the local repository and would be helpful if Copilot directly populates this in the VS Pro IDE's built-in Git module UI

Bring Visual Studio up to the same functionality/capabilities as VS Code in terms of Slash, # and @ shortcuts - It great to give solo and small shop developers capabilities, but it seems like enterprise companies using Visual Studio Pro/Enterprise are being left behind - this is said in the context of the various YouTube videos and other independent blogs showing Copilot use with VS Code and no obvious Visual Studio equivalent feature

Our #1 item is indexed repository code awareness in the IDE with "system message"/chat context sharing/editing coming in a close second. Block/method comments would be third on our list.

[eshwer]

This is incredibly helpful! Thank you for taking the time 🙏 I'm running through this feedback with the team and will circle back if we have follow ons!

[emartin-monterey]

One additional thought here in regards to improving user experience with code generation: when we ask copilot to do something like "Add a new static method for writing the configuration file to a CSV" and it has enough context (i.e. a read config from CSV method exists), it usually gives a workable answer, however, a lot of the time it shows place holders for existing code that is not changed like:

// Existing code...
// Method implementation remains the same
// The rest of your Program.cs code remains unchanged

This can cause the editor preview comparison screen to replace original code with "// Existing code..." for example when accepting the changes, so we end up copy and paste from the suggest code instead of directly being able to just update the change in the original code file. Do an operation like "replace all var with explicit types" does a good job of just updating changed code, so that would be the desired behavior in the sense of larger change previews. Another option would be to allow selecting part of the suggesting in the preview pane and accepting that partial code.

I will note that tacking on the end "show the complete code file" sometimes helps avoid these issues.

[eshwer]

I'm assuming this is in the IDEs? @emartin-monterey

[emartin-monterey]

I'm assuming this is in the IDEs? @emartin-monterey

Yes, that is correct,

[emartin-monterey]

@emartin-monterey 👋🏻 Thanks for taking the time to reach out with your detailed feedback - we find this super valuable to help us move in the right direction with Copilot 🤖

I've shared this with a few other folks at GitHub who will review and come back to you, but I can help on one part:

It was unexpected that Copilot in the IDE does not have access to the private Enterprise-based repositories, I would be good to know what GitHub's plans/timelines are for integrating this feature into the IDE chat/completion

Good news 🥳 This is already available in Visual Studio Code with @workspace, and it's available in beta in Visual Studio 17.11 Preview 2 as of June 13, 2024.

Does that help? If you give it a try, I'd love to hear what you think!

We have updated VS preview to Version 17.12.0 Preview 1.0 and it seems the "@github" feature for referencing indexed repositories shown in your link seems to have been removed, any updates on this? We also updated to the release version 17.11.1 of VS Pro and do not see the @github feature either.

[jeffrwsd]

I had co-pilot create a summary of my changes for me. It did a great job. Now I want to put that summary into the comment of the PR I'm creating. If I copy the summary and paste into the comment box I lose the Markdown. I need a way to copy the co-pilot response markdown and all so I can put it into the PR description/comment.

[timrogers]

👋🏻 Thanks for flagging! I can see that preserving formatting when you copy from Copilot Chat would be useful - I'll make sure that feedback gets to the right place.

I'm wondering if Copilot pull request summaries could be a better fit that avoids this problem. Have you tried that?

[jeffrwsd]

I found the summary option immediately after making this request. Though it solves my immediate problem I still think it’d be useful to copy markdown format for easy copy + past to comments or README.MD files or elsewhere. From: Tim Rogers ***@***.***> Sent: Wednesday, July 10, 2024 1:57 PM To: community/community ***@***.***> Cc: Jeff Jones ***@***.***>; Comment ***@***.***> Subject: [EXTERNAL]Re: [community/community] Copilot Enterprise - Feedback (Discussion #110314) 👋🏻 Thanks for flagging! I can see that preserving formatting when you copy from Copilot Chat would be useful - I'll make sure that feedback gets to the right place. I'm wondering if Copilot pull request ***@***.***/copilot/using-github-copilot/creating-a-pull-request-summary-with-github-copilot> could be a better fit that avoids this problem. Have you tried that? — Reply to this email directly, view it on GitHub<#110314 (reply in thread)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AK3VKAGMWMRR47V3BW7WBDDZLVYYRAVCNFSM6AAAAABD4MYPTKVHI2DSMVQWIX3LMV43URDJONRXK43TNFXW4Q3PNVWWK3TUHMYTAMBRGMYTANY>. You are receiving this because you commented.Message ID: ***@***.******@***.***>>

[mtaran]

Hi @arfon, long time no see :)

Now that I'm at METR, I've gotten a chance to use Copilot Enterprise features for real (I'd never really had a need to while working at GH), and... things aren't great. A specific problem I've noticed recently is:

Copilot is better than me at reading big SQL migrations and spotting potential issues, so I wanted to ask copilot about it from the web UI. I tried doing it from the file-diff ... menu but the result was not at all related to the question I asked.

Compare with what I was previously doing (before ponying up the extra 💰 for Enterprise) in VSCode:

The difference is pretty night and day!

Am I just holding this wrong, or what's going on?

[arfon]

👋 @mtaran !

It looks like Copilot (incorrectly) went and retrieved information about the thing you're looking at in the UI. A couple of questions (in the attached image below):

Essentially, I'm curious if you used either of the options in this dialog here? ("Ask Copilot about this diff" or "Attach to thread")?

[KBEMobisys]

Administration issue with CoPilot knowledge bases

This documentation tells you how to create a CoPilot knowledge base inside you organization. It tells you that only an organisation owner can create new knowledge bases. But this is only true if this organisation owner also has a CoPilot seat assigned. In our usecase the organisation owners do not need CoPilot so they do not have a seat assigned. And then the organisation owner can't create anything in the CoPilot knowledge bases.

From our point of view, this is an error of the permission/configuration concept of CoPilot. (Or you want to sell more CoPilot seats ;) )

[KBEMobisys]

If you want I can try to remove the CoPilot seat again and check how it looks then.

[timrogers]

Let me check and get back to you! There was a bug affecting this page, but I think it's been fixed.

[timrogers]

Thanks for your patience! I just checked and we do have an outstanding bug here, which means that if you don't have a Copilot Enterprise seat, you can't manage knowledge bases. We're working to get that fixed, and we expect it to be sorted by mid-August. Sorry for the inconvenience 😞 !

[KBEMobisys]

Great, to hear that a fix is on the way 😀. Thanks for the amazing feedback experience. I did not expect to have any answer 45 minutes after I posted the issue. That's awesome 🥳.

[khenckel]

Hi @KBEMobisys this issue should be fixed for you! Please let us know whether you still have this problem. 🙏

[ekroon]

I am getting constantly "This response could not be shown as it violates GitHub’s content policies." if I use copilot from a repo.

See this:

I don't think I am asking something weird here.

[khenckel]

Thanks for flagging this @ekroon! Is it just this example, or have you hit others? We experimented with a new filtering algorithm recently, and I'm wondering if that could be falsely flagging specific terms here (like calendar)

[beyondcompute]

Hello! What happened to Copilot recently? As if its “intelligence” has dropped significantly several weeks ago. Chat became next-to-useless and the quality of suggestions has deteriorated sharply, I would say.

Even when I write a comment: // Insert <MyComponent> below:, it cannot “copy-paste” the usage of the component from the adjacent file! 🤦‍♂️

Have you cut the computing power available to Business customers? Even if you haven’t, unfortunately it feels like that.

[khenckel]

@beyondcompute we did change the underlying model - is the problem mostly constrained to fetching relevant files?

[beyondcompute]

No, just the “quality of answers” even to general questions (like “how to do X in react-testing-library”). The answers feel comparable with Claude 3.5 Sonnet (used via poe.com) but when I “press” Copilot chat for different answers, I get “hallucinated” responses with non-existing APIs being “invented”, etc. Again, it feels like the quality of Copilot’s intelligence has deteriorated, that’s all. I prefer models available via Poe (for non-confidential, “general” questions) as of late.

[khenckel]

Completely understand. Are the problems involving public repositories or internal repositories specific to your enterprise? Or both?

[khenckel]

@beyondcompute which IDE are you using? And are you noticing this both inline in your text editor and in chat?

[roeishuster]

Hello,

For some reason I cannot use copilot chat in GitHub at all, this is the error I get for every operation I'm trying to do:
I'm sorry but there was an error. Please try again.

[eshwer]

It looks like it's an authorization issue. Can you confirm that you've been logged into your organization that has Copilot Enterprise?

[roeishuster]

@eshwer Yes, I can confirm I'm logged into the enterprise.
I'm also an enterprise owner, and this issue started randomly, so not sure where to start looking.

[eshwer]

Do you mind creating a support ticket? The team will help resolve with a more reliable SLA.

[roeishuster]

Yes, this is the ticket ID: 2939445

[balboFK]

Hello!
One of these days i tried generating a search query for a commit, on my case i was trying to filter all the commits that had "MAJOR" on their messages for a specific repository, but it responded as this:

And there are messages that includes "MAJOR".

I also tried changing the sentence writring and asking for a different word, I got another answer but still didnt found any commits.
Maybe i'm prompting or wording it incorrectly?

[balboFK]

Thanks for the reply @eshwer !
I see, thats good to hear! This could be really useful specially when you want to know when what thing happened, and even more if you use some sort of convetion on your commit messages writring.

I'll wait for your post of the changelogs!

[eshwer]

Hey @balboFK, mind trying this again? I would love to see if it works. We just released the ability to search commits.

[balboFK]

Hello @eshwer how are you? I tried using it, but since the start of this week, and mostly yesterday, I started receiving this message from any prompts.

As you can see on the image , I just started the conversation, and its already happening. So i haven't been able to use it as much. Its also hapenning a lot on my VSCode too, sadly.

[eshwer]

Hey, thanks for reporting, I've anecdotally have been seeing this a lot as well. I have escalated internally this issue and hopefully will resolve soon!

[balboFK]

I see! Thanks for your work @eshwer . I'll wait for an reply on it, then we can go back to testing the the ability to search commits.

[phillmv]

Gaaah, Copilot is now editing the answer as we go along?

It just spat something useful in the first iteration, but then self-edited the answer as it kept thinking about it – and now I can't see the useful first draft. It'd be better to show the history of the interaction, because otherwise it feels like gaslighting. Did I just see something and I blinked and now it's gone?

[eshwer]

Mind catching a screen recording?

[Elindo586]

My feedback is that I started using it after some troubleshooting installation, then I didn't want to use anymore and I tried to cancel the billing, but I had problems canceling the billing, then I decided to leave it as it was as it was helping on completing coding lines faster... then a few hours ago I went to update my billing, and for some reason I can't update my billing in Github, and about an hour ago I got an email from Github saying my access to CoPilot is cancelled.

I hope that if my access to Copilot is cancelled, hopefully that means I won't get charged for CoPilot.

For general coding, I was using Chat GTP as I never got the opportunity to talk with CoPilot.

Hopefully, if my access to Copilot is no longer connected to VS Code, then I hope I won't get a charge for CoPilot.

In a related topic, I still need assistance from Github to update my billing because I do want to sponsor a guy who is a great contributor for the community.

[lucien-heart]

Hey team, when I try to use Chat in github.com it's pretty frustrating.

Basically, if the issue is short enough, I can scan it quickly and understand the gist of the conversation. But if it's really long, I'd love to use Copilot to summarize and tell me about specific areas of interest.

For example, with the Copilot Usage Metrics API GA Issue, I asked,

"please summarize the main differences between the old and new api schemas."

and I got a return of the schemas without highlighting the differences and this message,

"Some of the discussion's comments could not be read because the discussion body and comments combined are too long."

"...because the discussion body and comments combined are too long."... that's exactly the use case I'm using the feature for. 🤷🏼‍♂️

Please let me know what I'm doing wrong here. 🙏🏼

[eshwer]

Inevitably for incredibly long discussions, we do not have the budget to digest all of the information however, we do have a truncation strategy in place that allows Copilot to get "the gist" to provide users a response. We are working to expand this budget, but even so I do see Copilot was able to provide a response to you. Was that response prior to that note helpful?

[lucien-heart]

Thanks @eshwer The response in this case was not helpful. It wasn't accurate, but more than that, it missed the point of my request all together.

Having said that, I think the request was a very difficult one in this case given the length and complexity of the conversation, but again, if the issues/discussions are NOT long and complex, then I don't really have a use case for engaging with Chat because I can quickly scan the issue or Discussion. So it seems to be a difficult problem to solve because the very attributes that make using the feature attractive, are the same attributes that make it difficult to provide a meaningful response.

Tough one! 😅

[ManavKumar2701]

Does anyone know How to integrate the co-pilot to review pull requests with Azure DevOps platform?

[ManavKumar2701]

@eshwer / @arfon / @phillmv Can anyone help me with this?

[arfon]

I'm afraid this isn't possible currently. / cc @timrogers incase he has any insights on longer term roadmaps.

[ManavKumar2701]

Thank you @arfon , I hope @timrogers have the insights, if we could integrate "copilot for Pull Requests" features with Azure DevOps then it will really help a lot of organisations.

[rajbos]

@ManavKumar2701 I am an external consultant working with GitHub a lot and we do have a pull request setup implemented with Microsoft for GitHub Enterprise Server (POC stage, going to POV in Q4). That could also work for Azure DevOps.

I don't see GitHub adding that functionality to Azure DevOps itself, as none of the UI changes are being moved there as far as we can see. I'd be happy to chat on it. Shoot me a message through LinkedIn if you want to discuss: https://linkedin.com/in/bosrob

[timrogers]

@ManavKumar2701 👋🏻 At the moment, we have no plans to bring Copilot pull request summaries, Copilot Chat in github.com or other pull request-related features to Azure DevOps. Sorry!

[mtm-zakir]

It was good.