#jython IRC Log (v0.9)

Index

IRC Log for 2012-02-10

Timestamps are in GMT/BST.

[0:02] <jimbaker> cleanup_hang, definitely possible. ThreadState has the potential to leak like this. to be fixed in the next version of jython - unfortunately we couldn't do it for 2.5.x, since backwards breaking api change
[0:05] <jimbaker> or for that matter PySystemState, as you implicate (shadow() is my hack to avoid backwards-breaking api changes). also to be fixed.
[0:07] * shashank (~shashank@ucb-np2-177.colorado.edu) has joined #jython
[0:14] * juneau001 (~juneau@50-103-53-55.dklb.il.frontiernet.net) has joined #jython
[0:23] <jimbaker> in fact, as i just looked at shadow support, this seems like something that should be done sooner than later
[0:24] <jimbaker> that is, a trivial branch
[0:32] * stakkars__ (~tismer@88.130.165.138) Quit (Quit: schnarch)
[2:20] * lheuer1 (~Adium@blfd-4d08ea9c.pool.mediaWays.net) has joined #jython
[2:21] * lheuer (~Adium@unaffiliated/lheuer) Quit (Ping timeout: 244 seconds)
[2:28] * shashank (~shashank@ucb-np2-177.colorado.edu) Quit (Quit: Leaving.)
[3:11] * clajo04 (~clajo04@pool-108-41-219-3.nycmny.fios.verizon.net) has joined #jython
[3:21] * clajo04 (~clajo04@pool-108-41-219-3.nycmny.fios.verizon.net) Quit ()
[4:37] * agronholm (~Demi-god@91.113.184.146) has joined #jython
[5:45] * lheuer1 is now known as lheuer
[5:45] * lheuer (~Adium@blfd-4d08ea9c.pool.mediaWays.net) Quit (Changing host)
[5:45] * lheuer (~Adium@unaffiliated/lheuer) has joined #jython
[6:50] * maxb_ (~maxb@jabberwock.vm.bytemark.co.uk) has joined #jython
[6:50] * maxb (~maxb@jabberwock.vm.bytemark.co.uk) Quit (Write error: Connection reset by peer)
[6:55] * er1k757 (~erik@tornado.beebe.cc) Quit (Ping timeout: 240 seconds)
[6:55] * cleanup_hang (ada04c41@gateway/web/freenode/ip.173.160.76.65) Quit (Ping timeout: 245 seconds)
[6:56] * Katharsis (~Katharsis@s42.linuxpl.com) Quit (Ping timeout: 244 seconds)
[6:57] * er1k757 (~erik@tornado.beebe.cc) has joined #jython
[6:58] * Katharsis (~Katharsis@s42.linuxpl.com) has joined #jython
[7:02] * r0bby (~wakawaka@guifications/user/r0bby) has joined #jython
[7:02] * robbyoconnor (~wakawaka@guifications/user/r0bby) Quit (*.net *.split)
[7:02] * lopex (u4272@gateway/web/irccloud.com/x-kcyiaegvzagoiqrr) Quit (*.net *.split)
[7:05] * agronholm (~Demi-god@91.113.184.146) Quit (Ping timeout: 244 seconds)
[7:09] * agronholm (~Demi-god@91.113.184.146) has joined #jython
[7:15] * r0bby is now known as robbyoconnor
[7:15] * K4sperle is now known as Kasperle
[7:15] * Kasperle is now known as 5EXAAA5EU
[7:16] * Arfrever (~Arfrever@apache/committer/Arfrever) Quit (Ping timeout: 260 seconds)
[7:24] * maxb_ (~maxb@jabberwock.vm.bytemark.co.uk) Quit (Write error: Broken pipe)
[7:32] * Katharsi1 (~Katharsis@s42.linuxpl.com) has joined #jython
[7:32] -christel- [Global Notice] Hi all, it would appear that we are the target of a dos attack this morning -- far from what you fancy before you've had your coffee! I apologise for the inconvenience, and we'll be working closely with our sponsors to try drop this traffic at the door.
[7:33] * agronholm (~Demi-god@91.113.184.146) Quit (Ping timeout: 248 seconds)
[7:33] * Katharsis (~Katharsis@s42.linuxpl.com) Quit (Ping timeout: 248 seconds)
[7:33] * agronholm_ (~Demi-god@91.113.184.146) has joined #jython
[7:34] * maxb (~maxb@80.68.92.224) has joined #jython
[7:49] * stakkars_ (~tismer@p5DDB6985.dip.t-dialin.net) has joined #jython
[7:50] * lahwran (lahwran@unaffiliated/lahwran) Quit (Ping timeout: 276 seconds)
[7:53] * stakkars (~tismer@p5DDB6985.dip.t-dialin.net) Quit (Ping timeout: 245 seconds)
[7:53] * stakkars_ is now known as stakkars
[7:56] * lahwran (lahwran@unaffiliated/lahwran) has joined #jython
[8:29] * agronholm_ (~Demi-god@91.113.184.146) Quit (*.net *.split)
[8:29] * srcerer (~chatzilla@dns2.klsairexpress.com) Quit (*.net *.split)
[8:29] * verterok (~ggonzalez@unaffiliated/verterok) Quit (*.net *.split)
[8:31] * srcerer (~chatzilla@dns2.klsairexpress.com) has joined #jython
[8:32] * agronholm_ (~Demi-god@91.113.184.146) has joined #jython
[8:35] * verterok (~ggonzalez@unaffiliated/verterok) has joined #jython
[8:42] * verterok (~ggonzalez@unaffiliated/verterok) Quit (*.net *.split)
[8:45] * verterok (~ggonzalez@91.189.93.107) has joined #jython
[8:45] * verterok (~ggonzalez@91.189.93.107) Quit (Changing host)
[8:45] * verterok (~ggonzalez@unaffiliated/verterok) has joined #jython
[9:01] * pjenvey_ (~pjenvey@underboss.org) has joined #jython
[9:02] * pjenvey (~pjenvey@underboss.org) Quit (Ping timeout: 252 seconds)
[9:02] * 5EXAAA5EU is now known as Kasperle
[9:02] * verterok (~ggonzalez@unaffiliated/verterok) Quit (Ping timeout: 252 seconds)
[9:07] * verterok (~ggonzalez@91.189.93.107) has joined #jython
[9:07] * verterok (~ggonzalez@91.189.93.107) Quit (Changing host)
[9:07] * verterok (~ggonzalez@unaffiliated/verterok) has joined #jython
[9:12] * maxb (~maxb@80.68.92.224) Quit (Ping timeout: 245 seconds)
[9:12] * maxb (~maxb@jabberwock.vm.bytemark.co.uk) has joined #jython
[9:16] * srcerer_ (~chatzilla@dns2.klsairexpress.com) has joined #jython
[9:21] * srcerer (~chatzilla@dns2.klsairexpress.com) Quit (Ping timeout: 248 seconds)
[9:38] * lahwran (lahwran@unaffiliated/lahwran) Quit (Ping timeout: 276 seconds)
[9:38] * lahwran (lahwran@unaffiliated/lahwran) has joined #jython
[10:25] * lopex (531346b2@gateway/web/freenode/ip.83.19.70.178) has joined #jython
[10:26] * lopex is now known as Guest63131
[10:36] * Guest63131 is now known as lopexx
[10:38] * lopexx is now known as lopex_
[11:10] * juneau001 (~juneau@50-103-53-55.dklb.il.frontiernet.net) Quit (Quit: juneau001)
[11:25] * lopex (u4272@gateway/web/irccloud.com/x-exbpkcsjffsubimj) has joined #jython
[11:34] * robbyoconnor (~wakawaka@guifications/user/r0bby) Quit (Ping timeout: 252 seconds)
[11:48] * lopex_ (531346b2@gateway/web/freenode/ip.83.19.70.178) Quit (Quit: Page closed)
[12:06] * Katharsi1 is now known as Katharsis
[12:11] * juneau001 (~juneau@131.225.24.172) has joined #jython
[13:52] * stakkars_ (~tismer@i59F75521.versanet.de) has joined #jython
[14:55] * enebo (~enebo@75-168-50-253.mpls.qwest.net) has joined #jython
[15:18] * juneau001 (~juneau@131.225.24.172) Quit (Read error: Connection reset by peer)
[15:32] * juneau001 (~juneau@FESS-116326.dhcp.fnal.gov) has joined #jython
[15:32] * juneau001 (~juneau@FESS-116326.dhcp.fnal.gov) Quit (Remote host closed the connection)
[15:32] * juneau001 (~juneau@131.225.24.172) has joined #jython
[16:02] * robbyoconnor (~wakawaka@guifications/user/r0bby) has joined #jython
[16:12] * robbyoconnor (~wakawaka@guifications/user/r0bby) Quit (Ping timeout: 248 seconds)
[16:15] * robbyoconnor (~wakawaka@guifications/user/r0bby) has joined #jython
[16:24] * stakkars_ (~tismer@i59F75521.versanet.de) Quit (Quit: schnarch)
[16:24] * r0bby (~wakawaka@guifications/user/r0bby) has joined #jython
[16:26] * robbyoconnor (~wakawaka@guifications/user/r0bby) Quit (Ping timeout: 240 seconds)
[16:26] * stakkars_ (~tismer@i59F75521.versanet.de) has joined #jython
[16:26] * stakkars_ (~tismer@i59F75521.versanet.de) Quit (Client Quit)
[16:33] * r0bby (~wakawaka@guifications/user/r0bby) Quit (Ping timeout: 244 seconds)
[16:34] * shashank (~shashank@63-228-87-227.hlrn.qwest.net) has joined #jython
[16:34] * shashank (~shashank@63-228-87-227.hlrn.qwest.net) Quit (Client Quit)
[16:36] * shashank (~shashank@63-228-87-227.hlrn.qwest.net) has joined #jython
[16:48] * shashank (~shashank@63-228-87-227.hlrn.qwest.net) Quit (Ping timeout: 252 seconds)
[16:59] * srcerer_ is now known as srcerer
[17:08] * shashank (~shashank@63-228-87-227.hlrn.qwest.net) has joined #jython
[17:23] * r0bby (~wakawaka@guifications/user/r0bby) has joined #jython
[17:38] * r0bby (~wakawaka@guifications/user/r0bby) Quit (Ping timeout: 240 seconds)
[17:41] * shashank (~shashank@63-228-87-227.hlrn.qwest.net) Quit (Ping timeout: 260 seconds)
[17:48] * njoyce (~njoyce@109.203.113.22) has joined #jython
[17:56] * r0bby (~wakawaka@guifications/user/r0bby) has joined #jython
[19:18] * r0bby (~wakawaka@guifications/user/r0bby) Quit (Read error: Connection reset by peer)
[19:43] * cleanup_hang (ada04c41@gateway/web/freenode/ip.173.160.76.65) has joined #jython
[19:43] <cleanup_hang> if a jython script imports threading (from Lib/threading.py) then a _MainThread() is created (line 273)
[19:44] <cleanup_hang> when _MainThread() is created, it registers the thread with _threading (from org/python/modules/_threading/_threading.java)
[19:44] <cleanup_hang> The registration map is *NOT* a java.lang.ThreadLocal construct
[19:45] <cleanup_hang> when an interpreter cleans up, it waits for all registered threads to die
[19:46] <cleanup_hang> so if two interpreters are concurrently created, and both import threading, then both threads will thusly be registered in the static _threading._threads map.
[19:47] <cleanup_hang> at that point, with both threads in the map, when the first one tries to cleanup and calls into _MainThread.__exitfunc() it will wait (JavaThread.join()) for the the second to complete.
[19:48] <cleanup_hang> ie, it will be waiting indefinitely for an unrelated thread.
[19:49] <cleanup_hang> One solution is to add a timeout to the join() call in _MainThread.__exitfunc()
[19:49] <cleanup_hang> A second solution is to make the guts of org/python/modules/_threading/_threading have some flavor of thread-locality (eg, java.lang.ThreadLocal)
[19:50] <cleanup_hang> fyi
[19:51] * juneau001 (~juneau@131.225.24.172) Quit (Quit: Take care...)
[19:52] <pjenvey_> if the PythonInterpreters have separate PySystemStates (sys module, and thus a different accompanying sys.modules) should in theory avoid this too
[19:53] * pjenvey_ (~pjenvey@underboss.org) Quit (Quit: ZNC - http://znc.sourceforge.net)
[19:54] * pjenvey (~pjenvey@underboss.org) has joined #jython
[19:56] <cleanup_hang> I'm running 2.5.2, and each interpreter is created with it's own shadowed PySystemState and ThreadState.
[19:57] <cleanup_hang> we ran into some 'shared PySystemState' issues before, and ensuring we have separate PySystemStates, each with shadow() call on them, fixed those issues.
[19:58] <cleanup_hang> This issue is specific to a "import threading" (or the like) call, which implicitly creates a new _MainThread() and registers it.
[20:00] <cleanup_hang> in other words, concurrently executing on N separate interpreters is working just fine *IFF* *ONE* of those interpreters ever actually imports threading. If > 1 concurrently executing interpreters import threading, then some of the interpreters will hang on a .cleanup() call.
[20:06] * clajo04_ (~clajo04_@pool-108-41-219-3.nycmny.fios.verizon.net) Quit (Quit: clajo04_)
[20:10] * clajo04_ (~clajo04_@pool-108-41-219-3.nycmny.fios.verizon.net) has joined #jython
[20:19] * lopex (u4272@gateway/web/irccloud.com/x-exbpkcsjffsubimj) Quit (Excess Flood)
[20:21] * lopex (~lopx@84-10-213-252.dynamic.chello.pl) has joined #jython
[20:32] * lopex_ (u4272@gateway/web/irccloud.com/x-gofxsktczzgvsnth) has joined #jython
[20:34] * lopex (~lopx@84-10-213-252.dynamic.chello.pl) Quit ()
[20:34] * lopex_ is now known as lopex
[20:38] * agronholm_ (~Demi-god@91.113.184.146) Quit (Ping timeout: 245 seconds)
[20:40] * lopex (u4272@gateway/web/irccloud.com/x-gofxsktczzgvsnth) Quit (Max SendQ exceeded)
[20:42] * jabley (u2487@gateway/web/irccloud.com/x-vhnrfficukirnlhq) Quit (Ping timeout: 276 seconds)
[20:42] * lopex (~lopx@84-10-213-252.dynamic.chello.pl) has joined #jython
[20:43] * stakkars_ (~tismer@p5DC47543.dip.t-dialin.net) has joined #jython
[20:51] * cleanup_hang (ada04c41@gateway/web/freenode/ip.173.160.76.65) Quit (Quit: Page closed)
[21:00] * stakkars_ (~tismer@p5DC47543.dip.t-dialin.net) Quit (Quit: schnarch)
[21:01] <jimbaker> cleanup_hang, maybe monkeypatch threading._register_thread and _unregister_thread (and referring functions) to not do this registration
[21:01] * jabley (u2487@gateway/web/irccloud.com/x-akrzhtbpfvgboaqr) has joined #jython
[21:01] <jimbaker> this might be a workaround for you
[21:01] <jimbaker> we will definitely want to audit any static fields like this for 2.6
[21:13] * stakkars_ (~tismer@p5DC47543.dip.t-dialin.net) has joined #jython
[21:17] * stakkars_ (~tismer@p5DC47543.dip.t-dialin.net) Quit (Client Quit)
[21:17] * lopex_ (u4272@gateway/web/irccloud.com/x-qwcyfwlpucivkijj) has joined #jython
[21:18] * stakkars_ (~tismer@p5DC47543.dip.t-dialin.net) has joined #jython
[21:42] * lopex (~lopx@84-10-213-252.dynamic.chello.pl) Quit ()
[21:42] * lopex_ is now known as lopex
[21:48] * juneau001 (~juneau@50-103-53-55.dklb.il.frontiernet.net) has joined #jython
[22:29] * Arfrever (~Arfrever@apache/committer/Arfrever) has joined #jython
[23:34] * stakkars_ (~tismer@p5DC47543.dip.t-dialin.net) Quit (Quit: schnarch)

Index

These logs were automatically created by JythonLogBot_ on irc.freenode.net using a slightly modified version of the Java IRC LogBot (github).