Tagged: Boat insurance
August 2, 2021 at 10:22 #19771
I made two submissions to the extended challenge and one to the core challenge last week yet they still remain on “pending score”. My first submission (two weeks ago) produced a score after an hour or so and I am curious why my last three submissions have been at “pending score” for a many days now?
I look forward to hearing from you.
August 13, 2021 at 08:42 #20886
August 14, 2021 at 13:53 #20983Alabi BojesomoParticipant
I am also experiencing delayed scoring for more than a day as opposed to an average waiting time of one hour that I am used to on this platform.
August 14, 2021 at 23:16 #21003moghadas76Participant
I have the same problem…Are we joke to you?
August 15, 2021 at 10:26 #21017
Thanks again for noticing us and apologies for the delay. The issue has been fixed now and the scores have been updated.
August 30, 2021 at 09:47 #22963nusabetslotParticipant
ok nice info
September 28, 2021 at 10:17 #24649
September 28, 2021 at 14:00 #24692
Hi @jaysantokhi ,
thanks for your note and sorry for the delay the issue is fixed now. We observed a couple of submissions of very large size that caused some delay and sometimes failing jobs. These large h5 files are using float64 as datatype (dtype(<f8)). The evaluation uses uint8 for the golden data comparisons and, hence, we would kindly ask you to also generate the submissions in uint8 (see also https://github.com/iarai/NeurIPS2021-traffic4cast/blob/master/util/h5_util.py#L60 ).
Thanks and best regards,
October 3, 2021 at 12:25 #25000
Good morning @moritzneun,
It seems this problem has occurred again on the Extended Challenge. Two submissions I made 16 hours ago are still on “pending score”. All of my submissions have been in the correct format (I make double-y sure before writing my predictions to file that they are in the correct uint8 format).
Is there a way for submissions that aren’t in the correct format (e.g. float64) to be flagged at point of submission so this issue doesn’t reoccur every few days, especially seeing as we are getting close to the deadline.
October 4, 2021 at 00:36 #25027tyron4lifeParticipant
People have so much work to do! Respect their time guys! 🙂 My submission will also be available!
October 4, 2021 at 15:00 #25062
we saw the pending score computations yesterday noon and fixed them. However, it seems, that your two pending submissions to the extended challenge, with a size of 270-280MB, were still in float64 (“<f8”) format. See my snippet below for checking the dtype:
>>> import h5py
>>> fr = h5py.File(‘<submission_id>/VIENNA/VIENNA_test_spatiotemporal.h5’)
>>> data = fr.get(“array”)
<HDF5 dataset “array”: shape (100, 6, 495, 436, 8), type “<f8”>
Nevertheless, we implemented a fix with force-converts non-uint8 input prior to any other computations. This reduces the load and hence should prevent the issue on the way forward.
- This reply was modified 11 months, 4 weeks ago by Christian Eichenberger.
June 9, 2022 at 00:03 #51943ecesancarParticipant
I tried to make new submissions on the Core and Extended Challenge submission boards but their status are still on “pending score” since last week. Did you close the submissions? If you did not can you please check the problem?
June 9, 2022 at 12:02 #52082
- The forum ‘General Questions’ is closed to new topics and replies.