Re: building an online judge to evaluate Python programs

Path	csiph.com!v102.xanadu-bbs.net!xanadu-bbs.net!news.albasani.net!news.stack.nl!newsfeed.xs4all.nl!newsfeed2.news.xs4all.nl!xs4all!post.news.xs4all.nl!not-for-mail
Return-Path	<python-python-list@m.gmane.org>
X-Original-To	python-list@python.org
Delivered-To	python-list@mail.python.org
X-Spam-Status	OK 0.007
X-Spam-Evidence	'H': 0.99; 'S': 0.00; 'exercise': 0.04; 'output': 0.05; 'sufficient': 0.05; 'subject:Python': 0.06; 'string': 0.09; 'received:80.91': 0.09; 'received:80.91.229': 0.09; 'received:gmane.org': 0.09; 'received:list': 0.09; 'python': 0.11; 'checkio.org': 0.16; 'code?': 0.16; 'inputs': 0.16; 'limit.': 0.16; 'received:80.91.229.3': 0.16; 'received:plane.gmane.org': 0.16; 'script,': 0.16; 'language': 0.16; 'wrote:': 0.18; 'seems': 0.21; 'tests': 0.22; 'this?': 0.23; 'header:User-Agent:1': 0.23; 'questions:': 0.24; 'sends': 0.24; 'tells': 0.24; 'script': 0.25; 'header:X-Complaints-To:1': 0.27; 'tried': 0.27; 'correct': 0.29; '(like': 0.30; 'program,': 0.31; 'url:wiki': 0.31; '(usually': 0.31; 'hacker': 0.31; 'subject:programs': 0.31; 'url:wikipedia': 0.31; 'run': 0.32; 'not.': 0.33; 'moment': 0.34; 'test': 0.35; 'there': 0.35; 'his/her': 0.36; 'next': 0.36; 'charset:us-ascii': 0.36; 'hi,': 0.36; 'similar': 0.36; 'url:org': 0.36; 'should': 0.36; 'wrong': 0.37; 'application': 0.37; 'list': 0.37; 'project': 0.37; 'step': 0.37; 'to:addr:python-list': 0.38; 'short': 0.38; 'to:addr:python.org': 0.39; 'mailing': 0.39; 'received:org': 0.40; 'how': 0.40; 'course.': 0.60; 'subject:online': 0.61; 'simple': 0.61; 'times': 0.62; 'our': 0.64; 'provide': 0.64; 'school': 0.64; 'judge': 0.68; 'user,': 0.69; 'online': 0.71; 'safe': 0.72; 'interest.': 0.81; 'failures.': 0.84; 'malicious': 0.84; 'spectacular': 0.91
X-Injected-Via-Gmane	http://gmane.org/
To	python-list@python.org
From	Dave Angel <davea@davea.name>
Subject	Re: building an online judge to evaluate Python programs
Date	Fri, 20 Sep 2013 19:55:24 +0000 (UTC)
References	<CAOuJsM=vWQifowsgVK+upBGA3BdqWbETstqXi9127gcU9coOhg@mail.gmail.com>
Mime-Version	1.0
Content-Type	text/plain; charset=US-ASCII
Content-Transfer-Encoding	7bit
X-Gmane-NNTP-Posting-Host	174.32.174.35
User-Agent	XPN/1.2.6 (Street Spirit ; Linux)
X-BeenThere	python-list@python.org
X-Mailman-Version	2.1.15
Precedence	list
List-Id	General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe	<https://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive	<http://mail.python.org/pipermail/python-list/>
List-Post	<mailto:python-list@python.org>
List-Help	<mailto:python-list-request@python.org?subject=help>
List-Subscribe	<https://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
Newsgroups	comp.lang.python
Message-ID	<mailman.199.1379706945.18130.python-list@python.org> (permalink)
Lines	35
NNTP-Posting-Host	2001:888:2000:d::a6
X-Trace	1379706945 news.xs4all.nl 15895 [2001:888:2000:d::a6]:47327
X-Complaints-To	abuse@xs4all.nl
Xref	csiph.com comp.lang.python:54508

Show key headers only | View raw

On 20/9/2013 13:28, Jabba Laci wrote:

> Hi,
>
> In our school I have an introductory Python course. I have collected a
> large list of exercises for the students and I would like them to be
> able to test their solutions with an online judge (
> http://en.wikipedia.org/wiki/Online_judge ). At the moment I have a
> very simple web application that is similar to Project Euler: you
> provide the ID of the exercise and the output of the program, and it
> tells you if it's correct or not. However, it can only be used with
> programs that produce an output (usually a short string or a number).
>
> In the next step I would like to do the following. The user can upload
> his/her script, and the system tests it with various inputs and tells
> you if it's OK or not (like checkio.org for instance). How to get
> started with this?
>
> There are several questions:
> * What is someone sends an infinite loop? There should be a time limit.
> * What is someone sends a malicious code? The script should be run in a sandbox.
>

That last seems to me to be the biggie.  Several times in the past few
years, people in this mailing list have tried to build a safe sandbox.
And each one was a big failure, for a hacker of sufficient interest.
Some of them were spectacular failures.

If you have to be safe from your user, Python may be the wrong language
to give them.


-- 
DaveA

Back to comp.lang.python | Previous | Next | Find similar | Unroll thread

Thread

Re: building an online judge to evaluate Python programs Dave Angel <davea@davea.name> - 2013-09-20 19:55 +0000

csiph-web