EBonocore's avatar

Github Copilot's quality has dropped severely in the past month

Has anyone experienced this lately?

I use PHPStorm and have been using Github Copilot since it was launched.

I started to use the chat as soon as it became available for JetBrains IDEs. But in the past month or so I noticed the quality of the code completions has deteriorated drastically, and the outputs in the chat are stubborn and just plain useless.

I use it a lot to write automated tests for me, and until a month ago it knew how to work with my codebase, but now it just spits out useless suggestions and keeps insisting on them even after I ask for it to use a different approach.

Has anyone else experienced issues with Github Copilot on PHPStorm lately?

0 likes
2 replies
LaryAI's avatar
Level 58

It sounds like you're experiencing some frustration with GitHub Copilot's recent performance in PHPStorm. While I can't directly address the quality of Copilot's suggestions, I can offer some steps to potentially improve your experience and troubleshoot the issue.

Steps to Improve GitHub Copilot's Performance

  1. Update PHPStorm and GitHub Copilot Plugin: Ensure that both PHPStorm and the GitHub Copilot plugin are up to date. Sometimes, updates include bug fixes and improvements that can resolve issues.

    # In PHPStorm, go to:
    Help -> Check for Updates
    
  2. Reconfigure GitHub Copilot: Sometimes, reconfiguring or resetting the plugin can help. You can disable and then re-enable the plugin.

    # In PHPStorm, go to:
    File -> Settings -> Plugins -> Installed
    # Find GitHub Copilot and disable it, then re-enable it.
    
  3. Clear Cache: Clearing the cache might help if there are any corrupted files causing the issue.

    # In PHPStorm, go to:
    File -> Invalidate Caches / Restart
    
  4. Provide Feedback: GitHub Copilot has a feedback mechanism. Use it to report the issues you're facing. This can help the developers improve the tool.

    # In PHPStorm, go to:
    Help -> Submit Feedback
    
  5. Check for Known Issues: Visit the GitHub Copilot repository or forums to see if there are any known issues or ongoing discussions about the problem.

    # GitHub Copilot repository:
    https://github.com/github/copilot
    
  6. Alternative Tools: If the issue persists, consider using alternative tools for code completion and automated test generation. Some popular alternatives include:

    • TabNine: An AI-powered code completion tool.
    • Kite: Another AI-based code completion tool.

Example: Using GitHub Copilot for Automated Tests

If you want to ensure that GitHub Copilot is generating useful automated tests, you can provide more context in your comments and code. Here's an example of how to guide Copilot to generate a PHPUnit test:

// src/Calculator.php
class Calculator {
    public function add($a, $b) {
        return $a + $b;
    }
}
// tests/CalculatorTest.php
use PHPUnit\Framework\TestCase;

class CalculatorTest extends TestCase {
    // Test the add method
    public function testAdd() {
        $calculator = new Calculator();
        $result = $calculator->add(2, 3);
        $this->assertEquals(5, $result);
    }
}

By providing clear and concise comments, you can help Copilot understand the context better and generate more accurate code.

Conclusion

While GitHub Copilot is a powerful tool, it may not always meet expectations. Keeping your tools updated, providing feedback, and exploring alternatives can help mitigate some of the issues you're facing. If the problem persists, consider reaching out to the GitHub Copilot support team for further assistance.

tisuchi's avatar

@ebonocore I am using it, but not heavily on it. Sometimes accept some auto-suggestions, but do not use the chat at all.

Regarding auto-suggestion, I didn't notice any drastic changes!

1 like

Please or to participate in this conversation.