DH at Penn Libraries. Increasingly stealthy. He/him, opinions mine, everything's a bookmark.
Joined July 2009
- Tweets 5,662
- Following 494
- Followers 609
- Likes 6,990
158 Photos and videos
26 May 2021
You have a dimension reduction problem and two solutions. One is simpler mathematically, but harder to explain. The other is more complex mathematically, but easier to explain. They work equally well. Which do you go with?
67%
Simple but hard
33%
Complex but easy
6 votes • Final results
1
Scott Enderle retweeted
21 May 2021
I've updated little-mallet-wrapper to output the MALLET diagnostics file (includes coherence) and the full word weight distributions for each topic. You can load the word weights and also compare pairs of topics using Jensen-Shannon divergence.
github.com/maria-antoniak/li…
12
58
19 May 2021
"As the black hole expanded along Spruce street, swallowing streetcars and Amazon delivery trucks whole, the Administrators realized the depth of their folly."
6
19 May 2021
Huh, more Fourier transforms. Overlaps in interesting ways with our HathiTrust ACS project. syncedreview.com/2021/05/14/…
wiki.htrc.illinois.edu/displ…
3
30 Apr 2021
If you have not already discovered Gutenberg, dammit, have a look, it's great! Really excellent for students and anybody who wants to play around with Gutenberg texts in a low-bar-to-entry way. github.com/aparrish/gutenber…
1
6
36
Scott Enderle retweeted
29 Apr 2021
something I didn't know until I went to law school(!!!!!!!) was that universal daycare was a popular — sometimes mainstream — feminist demand in the 1960s and 1970s. for all we talk about women empowerment, the arc of history, and so on, there was a giant leap back in the culture
69
977
8,097
12 Apr 2021
This thread is a good reminder that stopword lists are a form of feature selection. But "stopword list creation" sounds way less important and serious and frowny than "feature selection," doesn't it?
9 Apr 2021
Here are some words that scikit-learn, the popular Python machine learning library, gets rid of by default (stopwords):
- fire
- cry
- system
- serious
- empty
- thick
- thin
- whole
- describe
- detail
What the heck these are good words!
5
Scott Enderle retweeted
3 Apr 2021
Playing with the C4 corpus from @ai2_allennlp. Here are 1M occurrences of the words "red" and "blue" (500k each), embedded via DistilBERT, where the words are [MASK]'ed in the input sequences, and then the mask embedding is sliced out of the top layer. Then UMAP to 2d.
6
13
72
28 Mar 2021
Sympathetic with people's feeling that "bias" is too flawed, or too polysemous, or too loaded a term to be useful. But do we actually have any better terms for discussing the issue of—should I call it fairness?—in algorithms?
1
These are the four most popular misconceptions people have about race & gender bias in algorithms.
I'm wary of wading into this conversation again, but it's important to acknowledge the research that refutes each point, despite it feeling counter-intuitive.
Let me clarify.👇🏾
27 Mar 2021
FOUR things to know about race and gender bias in algorithms:
1. The bias starts in the data
2. The algorithms don't create the bias but they do transmit it
3. There are a huge number of other biases. Race and gender bias are just the most obvious
4. It's fixable! 🧵👇
26
1,049
2,917
28 Mar 2021
This is quite good.
28 Mar 2021
Wow, UMAP does metric learning now. Seems like it could be a really powerful tool for developing interpretable predictive models. umap-learn.readthedocs.io/en…
4
Scott Enderle retweeted
26 Mar 2021
We've developed a Gutenberg-HathiTrust parallel corpus of 19,049 pairs uncorrected OCR human-proofread books in 6 domains, publ. 1780-1993.
Description: hdl.handle.net/2142/109695
@hathitresearch @Ted_Underwood @profdownie @gworthey @miehumie
2
33
103
25 Mar 2021
When you throw vectors of LDA topics haphazardly at UMAP and get these triangle looking things — is it somehow recovering the shape of the Dirichlet prior?
1
3
Scott Enderle retweeted
22 Mar 2021
Going to present the work "Improving Measures of Text Reuse in English Poetry: A TF–IDF Based Method" co-authored with @Ted_Underwood at #iconference2021 on Wednesday. We validated the method through the example of text reuse between Yeats and the English Romantic poets.
1
10
45
Scott Enderle retweeted
19 Mar 2021
It's not a bug or typo either. I don't know the text (a short story collection) but it's a bizarre, fascinating passage. Immediately after the 79 repetitions of "butter": "Eugenie Grandet decides to kill her father."
3
2
13
Scott Enderle retweeted
17 Mar 2021
Few people realise that this country has fragments of a globally rare habitat: temperate rainforest.
Can you help me map the lost rainforests of England?
👇A brief thread about my new side-project: lostrainforestsofengland.org…
103
580
1,579