Today I discovered…
CodeRabbit AI PR Reviewer
A GitHub action to review code. Once installed, the AI bot (@coderabbit) reviews the code in the PR and provides suggestions by commenting on relevant code snippets. It also reviews additional commits when we act upon those suggestions.
💖 What I like about AI PR Reviewer:
Beyond a "GPT wrapper": This is the best use of GPT I have seen. It offers high-quality contextual review comments presented in an intuitive way that developers are familiar with.
Responds to comments: I was impressed to see that I can discuss the review comments with the bot.
Not verbose: It skips the in-depth review for trivial changes.
Does not hinder human review: It complements the existing human review workflow and can be done concurrently or sequentially. It can be customized for specific review purposes or even provide reviews in different languages. As a PR reviewer, I see how it enables my team to handle the initial level of review without having to wait for me. This enhances the team culture by promoting developer awareness of "code quality".
👎 What I dislike about AI PR Reviewer:
Response to comment was not instant: The CodeRabbit bot took about 20-30 seconds to respond to my comment. Although, I'm used to wait for even days for a response on the PR review comment, but knowing that it is coming from a machine makes me anxious to wait for even few seconds (thinking that it might not answer very well this time, but so far it's been great).
Start or stop review with a PR label: When the bot is configured to run manually, the bot review can be started or stopped via commands tagging the bot. I wished this manual trigger to start/stop was also possible via PR labels (adding a particular label to start review, or removing the label to stop review). This way, I would have been able to create my own automations around when to review a PR and when not to.
⭐ Ratings and metrics
Based on my experience, I would rate this project as following
Production readiness: 8/10
Docs rating: 6/10
Time to POC(proof of concept): less than 1 hour
Author: Harjot Gill @harjotsgill
Demo | Source
🛡 License: MIT
Tech Stack: Typescript, Node.js
If you discovered an interesting Open-Source project and want me to feature it in the newsletter, get in touch via the form above. To support this newsletter and Open-Source authors, follow #OpenSourceDiscovery on LinkedIn and Twitter