How to count all KS macros used in a quick Node script

[peterbe]

Suppose you ask yourself; what are the most commonly used kumascript macros in the content? Well, I often do and I often forget how I compute it. But sharing it here I'll remember to just copy-n-paste next time:

const { Document } = require("@mdn/yari/content");

const found = Document.findAll({
  // folderSearch: "web/javascript/reference/statements",
});
const counter = {};
for (const document of found.iter()) {
  for (const macro of fastKSParser(document.rawBody)) {
    if (!(macro in counter)) {
      counter[macro] = 0;
    }
    counter[macro]++;
  }
}
const items = Object.entries(counter).sort((a, b) => b[1] - a[1]);
for (const [name, count] of items) {
  console.log(name.padEnd(30), count.toLocaleString());
}

function* fastKSParser(s) {
  for (const match of s.matchAll(
    /\{\{\s*(\w+[\w-.]*\w+)\s*(\((.*?)\)|)\s*\}\}/gms
  )) {
    const { index } = match;
    if (s.charAt(index - 1) === "\\") {
      continue;
    }
    yield match[1];
  }
}

And I run it (from the root of the mdn/content repo) like this:

▶ CONTENT_ROOT=files node peterbe__count-macros-used.js

And the output is...:

domxref                        41,239
jsxref                         9,303
cssxref                        9,197
Compat                         8,685
Specifications                 6,894
HTMLElement                    5,087
APIRef                         4,950
DOMxRef                        3,261
bug                            3,156
SVGElement                     3,146
SVGAttr                        2,754
Glossary                       2,583
EmbedLiveSample                2,347
CSSxRef                        1,866
WebExtAPIRef                   1,752
htmlelement                    1,699
event                          1,658
optional_inline                1,600
HTTPHeader                     1,333
htmlattrxref                   1,326
SpecName                       1,149
SeeCompatTable                 1,131
Spec2                          1,114
EmbedInteractiveExample        999
CSSRef                         938
...

That's it.

[peterbe]

Because macros are called in a case-insensitive way, different case spellings are counted as different keys. You can fix that by

-  for (const macro of fastKSParser(document.rawBody)) {
+  for (let macro of fastKSParser(document.rawBody)) {
+    macro = macro.toLowerCase();