Layout optimization best practices: sources of your personal corpus (part 2)
Welcome back to our series on designing custom keymaps! After looking into how good/bad QWERTY is, the power of layers, and the potential of custom keymaps, last time we took the first real step by examining your options for compiling a corpus.
As a recap: The corpus is simply a big chunk of text. We use this collection of textual data, often a single text file, to characterize your typing habits (calculating various language statistics), and feed it directly or indirectly as an input into layout optimization algorithms – to find the optimal keymap for you!
Today we’ll expand on this idea by exploring your options if, like me, you prefer a personalized corpus rather than grabbing some general (and mostly irrelevant) data available online.
Image 1: Letter frequencies – the most basic use of corpora – in this very post
We've seen that a well-crafted, personalized corpus plays a key role in determining the outcome of the optimization process. We've also explored...
Figure 1: This is the keyboard of someone (0range) who clearly knows how to ask proper questions.
Over the past couple of weeks, I’ve been lurking around the channels of a couple of different entry level keyboard forums and I have to admit that the experience is quite bleak. I’m not saying this because of “toxicity” or people being given wrong information, rather I see so many people’s questions going unanswered… and to be honest they’re kind of to blame for it. While I recognize that not everyone coming freshly into the keyboard space enters it with the same level of inquisitiveness that I did when I first joined back in 2017, these questions going unanswered really feel way under-thought or over-thought compared to where I was. On one hand, you get questions like this:
What is best gaming keyboard?
And on the other hand, you get questions like this:
Hi, there everyone! I am just now starting to look into mechanical keyboards as an avid gamer and I need some help in...
Layout Optimization Best Practices: The Corpus (Part 1)
In this series we are designing our own custom keymaps, logical layouts, you name it. We’ve laid the groundwork by looking into how good/bad QWERTY is, the power of layers (SpaceFN), and also the huge potential of alternative layouts and custom keymaps. Today, we take the first step in designing your ultimate keymap by exploring our options for compiling a corpus.
What's a corpus? Essentially, it's just a fancy term for a big chunk of text. In this context it means a usually large collection of textual data used directly or indirectly as an input for our layout optimization algorithms. Often literally a single text file.
Why does it matter to you? Because a well-crafted, personalized corpus is crucial for keymap wizards. If you're aiming to design your own custom logical layout, the corpus plays a key role in determining the language statistics that reflect your typing habits, thus the outcome of the optimization. These statistics, which we extract through analysis of...
Fear and loathing on a PCB
At a recent keyboard meetup I was talking to someone very new to the hobby and they said that they bought a board and were surprised to discover that it was not hotswap. They were really intimidated by the idea of soldering their switches into their keyboard. Turns out, for some people, whipping out a blazing hot metal stick and possibly wrecking your expensive purchase gets them jittery.
All kidding aside, for the first year or so in the hobby, I purchased exclusively hotswap keyboards, avoiding soldering for a couple reasons. Firstly, I didn’t want to commit to any one switch. I liked clicky a lot early on (still do if I’m being honest) but I saw that the folks who had been in the hobby for longer moved away from clicky, and I predicted accurately that I too would do the same. Secondly, I was just coming to terms with what it cost to buy and build a keyboard, and soldering seemed like an unnecessary risk.
I can trace my initial...
I Think My Switch Is Stuck! - The Tale of Cherry MX Locks
Over the years of collecting mechanical keyboard switches, I’ve been lucky enough to have encountered dozens upon dozens of rare and unique ones that have stuck in my mind to this day. Prototypes, factory errors, and even a few switches so rare that there is literally zero documentation about them anywhere in the world all fill that personal list from top to bottom. However, I realize that talking about switches so far outside of most people’s reaches, and even sometimes my own grasp, doesn’t make for the most exciting of articles about switches. To this newest generation of keyboard enthusiasts, though, there is one pretty rare MX-style switch which has made its way to the top of everyone’s “must try” lists – Cherry MX Locks. These often undiscussed and even more rarely seen switches are something that few people have seen and even fewer have had the chance to try at a meetup before. However, the list of people who really know how these unique Cherry switches work is even shorter...
I must have watched this GMMK Pro pre-sale build video from a YouTuber named IO Sam a dozen times before I pulled out my wallet and pre-ordered it.
In retrospect, I learned a great deal about building keyboards from Sam’s straightforward, professional delivery. I watched and re-watched sections I didn’t understand, and certain phrases and moments in the video stuck with me in ways where I still think about them. Especially at 23:10, when he compliments the MT3 White on Black keycaps with an actual chef’s kiss, locks eyes with the camera and says “Perfecto.” (I still do that whenever I put MT3 WOB on a board.)
In that video, IO Sam introduced me to DROP, when he referenced the MT3 WOB’s and the GMK Kaiju keycaps that he set the Glorious GMMK Pro up with. I was in love with the look and feel of the MT3 profile. (I still am, as you can read in my previous article “In defense of MT3”) As a life-long Godzilla fanatic, I fell head over heals for GMK Kaiju. In the latter parts...
So in my previous write-up, while highlighting the benefits of alternative and custom layouts, I declared without much evidence that QWERTY is not that bad at all, and also that it is in the top 2% of all the possible layouts. Well, like so many times in life: it depends.
I did my original research many years ago - the exact value was in fact 1.82% -, but I forgot to mention that this is only valid in a special case: using my personal corpus and ruleset. It makes sense since back in the day I did this to support the design process of my own custom keymaps.
Anyway, it was high time to redo my original experiment, dive in this topic a bit deeper, and reveal the logic and method behind my calculations. Spoiler alert: I was wrong! Or was I? ;)
QWERTY
Everyone knows QWERTY I guess. Christopher Sholes, Remington 2 typewriter, preventing jamming of type bars, path dependence, whatever. I'm not going to cover it here, check this previous write-up of mine if you are interested...
Hall Effect: What is a Hall Effect switch and will it turn you into a gaming god?
TL;DR: Nope, but there are reasons why you may want to use a Hall Effect Keyboard.
Hall Effect switches are the newest trend in mechanical keyboard switches. From Gateron to Geon, switch manufacturers are starting to release HE switches. With Wooting at the forefront and seemingly the best implementation of Hall Effect technology, many other brands seem to be playing catch-up. We’ve seen releases like the RAKKA, BOOG75, DrunkDeer, and MOD007 HE start to stir up competition. But do you need another keyboard? Is this one going to be the end all be all for you? Is HE Endgame? If you’re like me, a keyboard enthusiast, your answers will probably be: no(yes), no, and no. Do I think that an HE board deserves a spot in your collection? Maybe… Let’s dive into the latest technological update to mechanical switches in a long time, and you can make that decision for yourself.
First, we need to know...
Typing out all the Harry Potter books would be crazy, right? What would be the point? Seems like a weird flex even by keyboard enthusiast standards. Yep, that's right. Typing it out once makes no sense. That's why I'm going to type out the books a few million times! For the benefit of humanity and especially of you, fellow keymap wizards.
This demonstration of the power of alternative/custom layouts is a shortened version of the original article at kbd.news. Given the huge extent of this topic, we can barely scratch the surface here so consider this write-up a mere teaser.
Imagine you are an aspiring writer with a brilliant idea, just about to start typing out your magnum opus, staring at a yet empty document on your screen. Cursor blinking, annoying orphan relatives locked up in the cupboard under the stairs.
Your story, about a young boy who ends up saving the world, is quite complete. You "just" have to type out heaps of your manuscripts and notes: about 6.5 million...
As we publish more articles in the "Mech Keys How-To" series currently ongoing, navigating the various topics and finding previous articles will only become more difficult. This thread will serve as a table of contents to help add some structure to the whole project.
Feel free to also suggest future topics in this thread, as it will surely be easier to identify gaps and opportunities for further exploration when viewing everything as a whole.
Mechanical Keyboards
Introductory Topics
Mechanical vs Membrane
Sizes and Layouts of Mechanical Keyboards
Short Intro Into Split Keyboards (dovenyi)
Staggered and Ortholinear Layouts
Low-Profile vs High-Profile Keyboard Designs
Build Materials and Other Case Design Considerations
Selecting Your First Mechanical Keyboard (The_Manic_Geek)
Keyboard Layouts
Support for Alternate Layouts (dvorcol)
What is SpaceFN and why you should give it a try (dovenyi)
Keymap Layout Analysis (Keymap wizardry: Typing out the Harry Potter saga)...