算法霸权
Weapons of Math Destruction
Cathy O'Neil · 初版 2016 年
68人推荐
112位读者提及
132次提及
为什么值得读
- 揭示算法模型如何放大并固化数据集中的固有偏见
- 剖析非因果性推理编码到AI中导致的伦理困境
- 探讨黑盒不透明规则在社会各领域造成的负面反馈
<strong>一位前华尔街宽客对充斥现代生活并威胁撕裂我们社会结构的数学模型敲响了警钟</strong> 我们生活在算法时代。影响我们生活的决策——我们在哪里上学、是否能获得汽车贷款、支付多少医疗保险费——正越来越多地由数学模型而非人类做出。从理论上讲，这应该带来更大的公平：每个人都按照相同的规则受到评判，偏见得以消除。但正如 Cathy O’Neil 在这本紧迫而必要的著作中所揭示的那样，事实恰恰相反
Hacker News 上怎么说
正在加载完整评论……
……没睡好或没吃好这种前置条件。对犯罪倾向进行自动化推断，完全排除了元准确度（即人类法官/考官的胜任能力）这一变量。拜托去读读《数学杀伤性武器》（Weapons of Math Destruction），了解一下机器学习在发现和利用数据集中的偏见方面有多“出色”。等等，不对，抱歉，情况更糟了：罪犯的上唇曲率平均要大23.4%……
…preconditioning of a bad sleep or meal. The automated inference on criminality eliminates the variable of meta-accuracy (the competence of the human judge/examiner) all together. Please, read Weapons of Math Destruction and understand how excellent machine learning is at discovering and exploiting the biases in datasets. Edit, no, sorry, it gets worse: the upper lip curvature is on average 23.4% larger for criminals…
……因果关系，仅仅基于相关性做出推断是站不住脚的。将站不住脚的推理编码进AI模型，尤其是当它还会强化既有的社会不公时，可以说是相当不道德的。Cathy O'Neil的《数学杀伤性武器》（Weapons of Math Destruction）对此进行了更深入的探讨。这是一个非常合理的担忧，尤其是非技术人员随着时间推移，逐渐被规训得对算法言听计从。
…causal link, making an inference based on correlation is unsound. Encoding unsound reasoning in an AI model, particularly when it reinforces an existing social imbalance, would be less than ethical. "Weapons of Math Destruction" by Cathy O'Neil delves into this in more depth. It's a very valid concern, particularly in the way non-technical people are trained over time to give deference to the algorithm.
……警务预测，鉴于基于AI的不公正现象常常困扰着这类应用缺乏透明度的专有属性，这确实值得反思。关于此类问题的另一场精彩讨论是Cathy O'Neil的书《数学杀伤性武器》（Weapons of Math Destruction）。可惜她没能共同获得松鼠奖。https://www.amazon.com/Weapons-Math-Destruction-Increases-In...
…policing which merit rethinking since AI-based injustice so offer bedevils the proprietary lack of transparency in such apps. Another excellent discussion of problems like these is Cathy O'Neil's book "Weapons of Math Destruction". Too bad she couldn't share the Squirrel prize. https://www.amazon.com/Weapons-Math-Destruction-Increases-In...
……我们始料未及的行为。试图孤立/建模这些系统中的单个组件本身就是有缺陷的方法。11. 《混沌猴子》（Chaos Monkeys，Antonio Garcia Martinez著）——很有趣，但篇幅挺长 12. 《数学杀伤性武器》（Weapons of Math Destruction，Cathy O'Neil著）——在某种程度上类似《系统思考》，但在应用层面。展示了当隐藏的负反馈循环出现时，现代社会中的规则如何产生意想不到的负面后果……
…behavior that we didn't expect. Trying to isolate / model a single component of one of these systems is a flawed approach. 11. Chaos monkeys (Antonio Garcia Martinez) - entertaining, but quite long 12. Weapons of math destruction (Cathy O'Neil) - in a way, similar to Thinking in systems, but at an applied level. Shows how rules in modern society can have unintended negative consequences when hidden negative feedback loops emerge…
想了解更多关于“伦理与算法”的信息，可以读读：《数学杀伤性武器》（Weapons of Math Destruction）[1]，或者至少听听作者和主持人Russ Roberts之间的EconTalk播客对谈[2] [1] https://www.amazon.com/Weapons-Math-Destruction-Increases-In... [2] http://www.econtalk.org/archives/2016/10/cathy_oneil_on_1.ht...
For more information about "ethics and algorithms", read: "Weapons of Math Destruction" [1] or at least listen to the EconTalk podcast between the author and host Russ Roberts [2] [1] https://www.amazon.com/Weapons-Math-Destruction-Increases-In... [2] http://www.econtalk.org/archives/2016/10/cathy_oneil_on_1.ht...
……种族不平等。或者为重罪犯提供量刑指南的算法。亦或是诊断医疗问题的算法。其他主题有些相似的著作：- Cathy O'Neil，《数学杀伤性武器：大数据如何加剧不平等并威胁民主》（Weapons of Math Destruction）[2] - Eli Pariser，《过滤泡泡》（The Filter Bubble）[3] 似乎还没有一个通用的术语能概括所有这4本书中的思想，但是……
…racial inequality. Or algorithms that provide sentencing guidelines for convicted felons. Or algorithms that diagnose medical problems. Other writings with somewhat similar themes: - Cathy O'Neil, "Weapons of Math Destruction - How Big Data Increases Inequality and Threatens Democracy"[2] - Eli Pariser, "The Filter Bubble"[3] There doesn't seem a universal term coined that generalizes the ideas in all 4 of those books but…