由买买提看人间百态

boards

本页内容为未名空间相应帖子的节选和存档,一周内的贴子最多显示50字,超过一周显示500字 访问原贴
USANews版 - Essay-Grading Software Offers Professors a Break
相关主题
现在GPA 也AA了即使共和党目前得势,长远看美国也doomed了
质疑米奇尼克 作者:仲维光可能 AA 并未歧视亚裔,而是亚裔自己的特性使然?
谈谈美国的MBA文化Students told to write 9/11 essay from terrorist's viewpoint
sca5的学生作文--“浓墨重彩”的好文章白宫请愿:禁止大学招生看到申请者种族信息
被两个蕾丝边养大的小孩一直想要一个真正的父亲被歧视不可怕,被歧视了还要帮对方洗地最垃圾
你们根本不知道华人子女为了推藤在高中有多苦喜大普奔:stanford, princeton取消SAT/ACT作文
可能是我小人之心小黄人名校疯终于明白了什么叫釜底抽薪
真的假的? Trump 最爱的10本书, 6本是关于中国的你把考试玩坏了 别人也只能不看考试了
相关话题的讨论汇总
话题: software话题: edx话题: grade话题: automated话题: grading
进入USANews版参与讨论
1 (共1页)
m********a
发帖数: 1041
1
Imagine taking a college exam, and, instead of handing in a blue book and
getting a grade from a professor a few weeks later, clicking the “send”
button when you are done and receiving a grade back instantly, your essay
scored by a software program.
And then, instead of being done with that exam, imagine that the system
would immediately let you rewrite the test to try to improve your grade.
EdX, the nonprofit enterprise founded by Harvard and the Massachusetts
Institute of Technology to offer courses on the Internet, has just
introduced such a system and will make its automated software available free
on the Web to any institution that wants to use it. The software uses
artificial intelligence to grade student essays and short written answers,
freeing professors for other tasks.
The new service will bring the educational consortium into a growing
conflict over the role of automation in education. Although automated
grading systems for multiple-choice and true-false tests are now widespread,
the use of artificial intelligence technology to grade essay answers has
not yet received widespread endorsement by educators and has many critics.
Anant Agarwal, an electrical engineer who is president of EdX, predicted
that the instant-grading software would be a useful pedagogical tool,
enabling students to take tests and write essays over and over and improve
the quality of their answers. He said the technology would offer distinct
advantages over the traditional classroom system, where students often wait
days or weeks for grades.
“There is a huge value in learning with instant feedback,” Dr. Agarwal
said. “Students are telling us they learn much better with instant feedback
.”
But skeptics say the automated system is no match for live teachers. One
longtime critic, Les Perelman, has drawn national attention several times
for putting together nonsense essays that have fooled software grading
programs into giving high marks. He has also been highly critical of studies
that purport to show that the software compares well to human graders.
“My first and greatest objection to the research is that they did not have
any valid statistical test comparing the software directly to human graders,
” said Mr. Perelman, a retired director of writing and a current researcher
at M.I.T.
He is among a group of educators who last month began circulating a petition
opposing automated assessment software. The group, which calls itself
Professionals Against Machine Scoring of Student Essays in High-Stakes
Assessment, has collected nearly 2,000 signatures, including some from
luminaries like Noam Chomsky.
“Let’s face the realities of automatic essay scoring,” the group’s
statement reads in part. “Computers cannot ‘read.’ They cannot measure
the essentials of effective written communication: accuracy, reasoning,
adequacy of evidence, good sense, ethical stance, convincing argument,
meaningful organization, clarity, and veracity, among others.”
But EdX expects its software to be adopted widely by schools and
universities. EdX offers free online classes from Harvard, M.I.T. and the
University of California, Berkeley; this fall, it will add classes from
Wellesley, Georgetown and the University of Texas. In all, 12 universities
participate in EdX, which offers certificates for course completion and has
said that it plans to continue to expand next year, including adding
international schools.
The EdX assessment tool requires human teachers, or graders, to first grade
100 essays or essay questions. The system then uses a variety of machine-
learning techniques to train itself to be able to grade any number of essays
or answers automatically and almost instantaneously.
The software will assign a grade depending on the scoring system created by
the teacher, whether it is a letter grade or numerical rank. It will also
provide general feedback, like telling a student whether an answer was on
topic or not.
Dr. Agarwal said he believed that the software was nearing the capability of
human grading.
“This is machine learning and there is a long way to go, but it’s good
enough and the upside is huge,” he said. “We found that the quality of the
grading is similar to the variation you find from instructor to instructor.

EdX is not the first to use automated assessment technology, which dates to
early mainframe computers in the 1960s. There is now a range of companies
offering commercial programs to grade written test answers, and four states
— Louisiana, North Dakota, Utah and West Virginia — are using some form of
the technology in secondary schools. A fifth, Indiana, has experimented
with it. In some cases the software is used as a “second reader,” to check
the reliability of the human graders.
----------------------------------------------------------------------------
----
But the growing influence of the EdX consortium to set standards is likely
to give the technology a boost. On Tuesday, Stanford announced that it would
work with EdX to develop a joint educational system that will incorporate
the automated assessment technology.
Two start-ups, Coursera and Udacity, recently founded by Stanford faculty
members to create “massive open online courses,” or MOOCs, are also
committed to automated assessment systems because of the value of instant
feedback.
“It allows students to get immediate feedback on their work, so that
learning turns into a game, with students naturally gravitating toward
resubmitting the work until they get it right,” said Daphne Koller, a
computer scientist and a founder of Coursera.
Last year the Hewlett Foundation, a grant-making organization set up by one
of the Hewlett-Packard founders and his wife, sponsored two $100,000 prizes
aimed at improving software that grades essays and short answers. More than
150 teams entered each category. A winner of one of the Hewlett contests,
Vik Paruchuri, was hired by EdX to help design its assessment software.
“One of our focuses is to help kids learn how to think critically,” said
Victor Vuchic, a program officer at the Hewlett Foundation. “It’s probably
impossible to do that with multiple-choice tests. The challenge is that
this requires human graders, and so they cost a lot more and they take a lot
more time.”
Mark D. Shermis, a professor at the University of Akron in Ohio, supervised
the Hewlett Foundation’s contest on automated essay scoring and wrote a
paper about the experiment. In his view, the technology — though imperfect
— has a place in educational settings.
With increasingly large classes, it is impossible for most teachers to give
students meaningful feedback on writing assignments, he said. Plus, he noted
, critics of the technology have tended to come from the nation’s best
universities, where the level of pedagogy is much better than at most
schools.
“Often they come from very prestigious institutions where, in fact, they do
a much better job of providing feedback than a machine ever could,” Dr.
Shermis said. “There seems to be a lack of appreciation of what is actually
going on in the real world.”
m********a
发帖数: 1041
2
我贊成.
美國人寫文章其實滿八股的, 只要格式對了, 熟習那個領域的遣詞造句,就算合格了.
這軟體應該可以幫助老師快點爬出滿坑滿谷的作文堆^^
k****k
发帖数: 3322
3
你的英文帖子真长,要有耐心地看,我需要这个软件。
m********a
发帖数: 1041
4
我也覺得整篇貼上來不太禮貌,可是我沒你"翻譯摘要兼講評"集一身的本事啊!

【在 k****k 的大作中提到】
: 你的英文帖子真长,要有耐心地看,我需要这个软件。
1 (共1页)
进入USANews版参与讨论
相关主题
你把考试玩坏了 别人也只能不看考试了被两个蕾丝边养大的小孩一直想要一个真正的父亲
印度人厉害了,美籍华人要加油了!你们根本不知道华人子女为了推藤在高中有多苦
简单的道理:最低工资越高,机器人代替工人的可能性越大可能是我小人之心
Today's Grade-Inflated, Lake Wobegon World; Letter Grade of A Now Most Common College Grade真的假的? Trump 最爱的10本书, 6本是关于中国的
现在GPA 也AA了即使共和党目前得势,长远看美国也doomed了
质疑米奇尼克 作者:仲维光可能 AA 并未歧视亚裔,而是亚裔自己的特性使然?
谈谈美国的MBA文化Students told to write 9/11 essay from terrorist's viewpoint
sca5的学生作文--“浓墨重彩”的好文章白宫请愿:禁止大学招生看到申请者种族信息
相关话题的讨论汇总
话题: software话题: edx话题: grade话题: automated话题: grading