I imported the full Linux kernel git history into pgit (oseifert.ch)

by ImGajeed76 45 comments 162 points
Read article View on HN

45 comments

[−] tonnydourado 36d ago
That was an informative post but Jesus Christ on a bicycle, reign in the LLM a bit. The whole thing was borderline painful to read, with so many "GPTisms" I almost bailed out a couple of times. If you're gonna use this stuff to write for you, at least *try* to make it match a style of your own.
[−] vidarh 36d ago
To add a tip on how to make it match your own style: You can get decently far by pointing it to a page or so of your own writing, and simply tell it to review the post section by section and edit it to match the tone and style of the example. It's not perfect by any means, but it will tend to edit out the type of language you're not likely to use, so really to make it sound less LLM-like, almost any writing sample from a human author works.
[−] mplanchard 36d ago
You can also just write it.

I’d much rather read someone’s imperfect writing than the soulless regression-to-the-mean that LLMs produce. If you’re not a native speaker or don’t have confidence in your writing, I’d urge you to first ask for an edit by another human, but if that’s not an option, to be extremely firm in your LLM prompting to just have it fix issues of grammar, spelling, etc.

[−] erichanson 36d ago
"soulless regression-to-the-mean", damn that's quote of the day.
[−] vidarh 36d ago
Almost nobody recognises well written AI texts. I've seen plenty of AI written text pass right by people who are sure they can always tell. It takes very little, because the vast majority of AI writing you spot involves people doing nothing to make it clean up the style.
[−] vidarh 36d ago
I find it quite funny how this got downvoted. My statement is based on concrete knowledge of a project that tested this, and demonstrated quite conclusively that most people consistently fail to detect AI written text that's gone through even very basic measures to seem more human.
[−] seizethegdgap 36d ago
Is it really worth your time to complain about fake internet points on a comment nested 4 deep?
[−] mplanchard 36d ago
I did bail out because of this, despite being pretty interested in the content. I love reading, but I cannot stand LLM “writing” output, and few things are important enough for me to force myself through the misery of ingesting ChatGPT “prose.” I only made it to the second section of this one.
[−] darkwater 36d ago
100% agreed. Maybe this inner reaction will disappear over the years of being exposed to the GPT writing style, or maybe LLMs will be "smarter" on this regard, and being able to use different styles even by default. But I had the same exact feelings as you reading this piece.
[−] vidarh 36d ago
It's really simple to fix by asking an LLM to apply a style from a sample, so my guess is a lot of product will build in style selection, and some provider will add more aggressive rules in their system prompts over time.
[−] jillesvangurp 36d ago
I would recommend using guard rails to guide tone, phrasing, etc. This helps prevent whole categories of bad phrasing. It also helps if you provide good inputs for what you actually want to write about and don't rely too much on it just filling empty space with word soup. And iterate on both the guard rails and the text.
[−] multjoy 36d ago
Or, you know, just write it yourself.
[−] joshwillik 36d ago
[dead]
[−] mplanchard 36d ago
It’s not even just about the style. It’s a matter of respect for your readers. If you can’t be bothered to take the time to write it, why on earth should I care enough to take the time to read it?
[−] vidarh 36d ago
If the content has value, I could not care less.
[−] darkwater 36d ago
Yes, but you need a style before :) But in TFA's author case, he actually had a few other blog posts which feel not LLM generated to use as an example, I agree.
[−] vidarh 36d ago
But for plenty of applications it doesn't need to be your personal style. It only needs to be your personal style if you want to present it as your own writing. Otherwise it just matters that it's well written. A catalogue of styles would work well for lots of uses.
[−] 47282847 36d ago
„Rewrite in a style appealing to Hacker News users critical of AI slop“.
[−] vidarh 36d ago
I mean, there are lots of people here that writes well enough that giving it some style samples and tell it to adapt the text to "this style: [insert post]" wouldn't be the worst idea.
[−] consp 36d ago
I stopped at "pgit handled it.". The tldr was appreciated though as now I don't have to sieve though the LLM bloat.
[−] ImGajeed76 36d ago
[dead]
[−] tombert 37d ago
If I recall correctly, the Fossil SCM uses SQLite under the covers for a lot of its stuff.

Obviously that's not surprising considering its creator, but hearing that was kind of the first time I had ever considered that you could translate something like Git semantics to a relational database.

I haven't played with Pgit...though I kind of think that I should now.

[−] anitil 37d ago
The sqlite project actually benefited from this dogfooding. Interestingly recursive CTEs [0] were added to sqlite due to wanting to trace commit history [1]

[0] https://sqlite.org/lang_with.html#recursive_query_examples

[1] https://fossil-scm.org/forum/forumpost/5631123d66d96486 - My memory was roughly correct, the title of the discussion is 'Is it possible to see the entire history of a renamed file?'

[−] anitil 37d ago
On and of course, the discussion board is itself hosted in a sqlite file!
[−] 20after4 36d ago
When you import a repository into Phabricator, it parses everything into a MySQL database. That's how it manages to support multiple version control systems seamlessly as well as providing a more straightforward path to implementing all of the web-based user interface around repo history.
[−] gjvc 37d ago
"If I recall correctly, the Fossil SCM uses SQLite under the covers for a lot of its stuff."

a fossil repository file is a .sqlite file yes

[−] ptdorf 37d ago
So SQLite is versioned in SQLite.
[−] yjftsjthsd-h 36d ago
Yep:) To be fair, I expect git to be stored in git, mercurial to be in mercurial, and... Actually now I wonder how svn/cvs are developed/versioned.
[−] tombert 37d ago
Makes sense, I haven't used the software in quite awhile.
[−] adastra22 36d ago
Git was a (poor) imitation of the monotone DVCS, which stored its data in sqlite.
[−] ImGajeed76 36d ago
you should! "go install" it and you're up in a minute.
[−] spit2wind 36d ago

> only a handful of VCS besides git have ever managed a full import of the kernel's history. Fossil (SQLite-based, by the SQLite team) never did.

I find this hard to believe. I searched the Fossil forums and found no mention of such an attempt (and failure). Unfortunately, I don't have a computer handy to verify or disprove. Is there any evidence for this claim?

[−] corbet 36d ago
I hate to blow our own horn, but I'm gonna...if you are interested in seeing this kind of kernel-development data mining, fully human-written, LWN posts it every development cycle. The 6.17 version (https://lwn.net/Articles/1038358/) included the buggiest commit and much surrounding material. See our kernel index (https://lwn.net/Kernel/Index/#Releases) for information on every kernel release since 2.6.20.

Or see LWN on Monday for the 7.0 version :)

[−] anonair 36d ago
I wish one day tools like gitlab and forgejo ditch filesystem storage for git repos and put everything in sqldb. I’m tired of replicating files for DR
[−] niobe 37d ago
Very cool
[−] gurjeet 37d ago
Technically correct title would be: s/Kernel into/Kernel Git History into/

    Pgit: I Imported the Linux Kernel Git History into PostgreSQL
[−] JodieBenitez 37d ago
Read the title and immediately thought "what a weird way to solve the performance loss with kernel 7..." The mind tricking itself :)
[−] srslyTrying2hlp 37d ago
[dead]
[−] QuiCasseRien 37d ago
[flagged]