Gomocup

{{Short description|Gomoku and Renju tournament for AIs}}

Gomocup is a worldwide tournament of artificial intelligences (AI) playing Gomoku and Renju. The tournament has been played since 2000 and takes place every year.{{cite web|title=The Gomoku AI programming tournament|url=http://gomocup.org/home/|website=Gomocup|url-status=dead|archiveurl=https://web.archive.org/web/20160604205643/http://gomocup.org/home/|archivedate=2016-06-04}} As of 2016,{{cite news|title=Gomocup 2016, the 17th tournament (April the 22nd-24th, 2016)|url=http://gomocup.org/results/gomocup-result-2016/}} it is the most famous and largest Gomoku AI tournament in the world, with around 40 participants from about 10 countries.

Rules

Gomocup has been played in the freestyle Gomoku rule with the board size of 20 since it was started in 2000.{{Cite web|url=http://gomocup.org/detail-information/|title=Detailed Information|last=|first=|date=|website=Gomocup|publisher=|access-date=}} In 2009, the standard Gomoku rule was added into Gomocup as a tournament, in which the board size is 15 and more than five in a row is not considered to be a win.{{Cite web|url=http://gomocup.org/results/gomocup-result-2009/|title=Gomocup 2009, the 10th tournament (April the 4th, 2009)|last=|first=|date=|website=Gomocup|publisher=|access-date=}} In 2016, the Renju rule was also added into Gomocup, with a board size of 15 and forbidden moves for black.{{Cite web|url=http://gomocup.org/gomocup-2016-announcement/|title=Gomocup 2016 Announcement|last=|first=|date=|website=Gomocup|publisher=|access-date=|archive-url=https://web.archive.org/web/20160514045616/http://gomocup.org/gomocup-2016-announcement/|archive-date=2016-05-14|url-status=dead}} In particular, since there are a large number of participants in the freestyle Gomoku tournament, the freestyle Gomoku tournament is divided into several leagues, and the fast game tournament is introduced.{{Cite web|url=http://gomocup.org/results/gomocup-result-2005/|title=Gomocup 2005, the 6th tournament (April the 16th, 2005)|last=|first=|date=|website=Gomocup|publisher=|access-date=}}

To get rid of the fact that there is a winning strategy for the player who plays first in Gomoku,{{Cite web|url=http://www.renju.nu/wp-content/uploads/sites/46/2016/09/Go-Moku.pdf|title=Go-Moku and Threat Space Search|access-date=2017-05-07|archive-date=2016-09-28|archive-url=https://web.archive.org/web/20160928113745/http://www.renju.nu/wp-content/uploads/sites/46/2016/09/Go-Moku.pdf|url-status=dead}} balanced openings have been prepared by Gomoku experts since 2006.{{Cite web|url=http://gomocup.org/results/gomocup-result-2006/|title=Gomocup 2006, the 7th tournament (April the 28th, 2006)|last=|first=|date=|website=Gomocup|publisher=|access-date=}} Games would be started from these balanced openings, and neither side would have a big advantage from the very beginning.

AI vs. Human Tournament

There were two AI vs. Human tournaments held in the Czech Republic in 2006 and 2011.

In 2006, the top 3 programs in Gomocup had a tournament with 3 of the top 10 players in Piškvorky online. There were 2 games between each pair of AI and human players. The result was one win, one draw and one loss for AIs, and the total score was 3:3.{{Cite web|url=http://gomocup.org/results/ai-human-2006/|title=The 1st tournament AI vs. Human (November the 11th, 2006)|last=|first=|date=|website=Gomocup|publisher=|access-date=2016-06-02}}

In 2011, the tournament was between the top 4 programs in Gomocup and 4 players at the top of the Czech Gomoku rating list. Similar to the 1st tournament, there were 2 games between each pair of AI. This time there were 3 draws and 1 win for AIs, and the total score was 5:3.{{Cite web|url=http://www.piskvorky.cz/clanky/zajimavosti-ze-sveta-piskvorek-a-renju/ai-vs-clovek-2011-2/|title=AI vs. Člověk 2011 {{!}} Česká federace piškvorek a renju|website=www.piskvorky.cz|access-date=2016-06-02}}

Elo Rating

The Elo rating system for Gomocup was built in 2016 and calculated with all the historical tournament results ever since.{{Cite web|url=http://gomocup.org/elo-ratings/|title=Elo Ratings|last=|first=|date=|website=Gomocup|publisher=|access-date=}} The rating is calculated with the open-source tool BayesElo,{{Cite web|url=http://www.remi-coulom.fr/Bayesian-Elo/|title=Bayesian Elo Rating|last=Coulom|first=Rémi|website=www.remi-coulom.fr|access-date=2016-06-02}} with a few parameters modified to get adapted to the Gomoku game. There is a rating list for each game rule. The Elo ratings are updated every year after the Gomocup tournament finishes.

style="vertical-align: top;"

|

{| class="wikitable"

|+ Elo Ratings for Freestyle Gomoku

RankAIAuthorCountryElo Rating
1YixinSun KaiChina2409
2GoroVictor BarykinRussia1981
3RenjuSolverWen XiangdongChina1951
4SlowRenjuHao TianyiChina1937
4TitoAndrej TokarjevHungary1928
6HewerTomas KubesCzech Republic1887
7SwineJiri FontanCzech Republic1843
8OnixIstvan Virag
Janos Wagner
Hungary1843
9CarbonMichal CzardybonPoland1810
10HGardenHan BingqingChina1739
11WineWang JinjieChina1696
12EmbryoMira FontanCzech Republic1647
13PelaPetr LastovickaCzech Republic1632
14WhoseHou WenCzech Republic1608
15GMotorRoman VancuraCzech Republic1555
16HFMCsaba JerglerHungary1549
17KanecJaroslav BabakCzech Republic1509
18ChisZheng PeimingChina1472
19ZetorTomas ChmelaCzech Republic1455
20XoXoJakub HorakCzech Republic1442
21HighFivePeter KarpovRussia1429
22BetaTomas KubesCzech Republic1362
23BestmoveWen XiangdongChina1292
24EulringBian JunyiChina1286
25AmoebaGalli ZoltanHungary1283
26PecuchetVilem WalterCzech Republic1204
27JudeLi TianChina1200
28SparkleLee JaechanSouth Korea1172
29IgnitorLee JaechanSouth Korea1100
30QMentatVojta HavranekCzech Republic1083
31KrysaJiri FontanCzech Republic1080
32NoesisMark MammelUnited States1065
33NabamokuJiri IsaCzech Republic1011
34TrunkatJiri TrunkatCzech Republic1000
35PureGMPaul DwyerJapan993
36ImroImrich KovacSlovakia972
37PuskvorecPatrik BezdicekCzech Republic969
38FastGomokuWang ZhengChina932
39PisqMartin PetricekCzech Republic897
40DjallLadislav PetrCzech Republic969
41LichtLi XinhuiChina814
42BruteforVasek SynacekCzech Republic811
43StahlfaustMarco Kunze
Sebastian Nowozin
Germany806
44ValkyrieTakashi KokubunJapan792
45LeonardoMilan MatlakCzech Republic792
46BenjaminBenjamin VejnarCzech Republic789
47FiveRowYaroslavUkraine782
48AIJan MacuraCzech Republic754
49DeepBlueVojta HavranekCzech Republic742
50PureRockyPaul DwyerJapan740
51CrusherNils BeckmannGermany672
52CurnpisJan CurnCzech Republic662
53PrologDavid MacekCzech Republic623
54MushroomChen KaiChina383

|

class="wikitable"

|+ Elo Ratings for Fastgame Gomoku

RankAIAuthorCountryElo Rating
1YixinSun KaiChina2297
2GoroVictor BarykinRussia2073
3HewerTomas KubesCzech Republic1930
4SlowRenjuHao TianyiChina1863
5TitoAndrej TokarjevHungary1855
6SwineJiri FontanCzech Republic1789
7CarbonMichal CzardybonPoland1780
8HGardenHan BingqingChina1705
9WineWang JinjieChina1695
10PelaPetr LastovickaCzech Republic1663
11EmbryoMira FontanCzech Republic1658
12WhoseHou WenChina1630
13GMotorRoman VancuraCzech Republic1606
14ChisZheng PeimingChina1598
15HFMCsaba JerglerHungary1545
16XoXoJakub HorakCzech Republic1505
17HighFivePeter KarpovRussia1480
18KanecJaroslav BabakCzech Republic1466
19ZetorTomas ChmelaCzech Republic1456
20AmoebaGalli ZoltanHungary1325
21EulringBian JunyiChina1310
22LichtLi XinhuiChina1283
23PecuchetVilem WalterCzech Republic1230
24JudeLi TianChina1219
25SparkleLee JaechanSouth Korea1219
26IgnitorLee JaechanSouth Korea1139
27QMentatVojta HavranekCzech Republic1086
28NoesisMark MammelUnited States1061
29TrunkatJiri TrunkatCzech Republic1060
30ImroImrich KovacSlovakia1019
31PuskvorecPatrik BezdicekCzech Republic1011
32NabamokuJiri IsaCzech Republic1000
33PureGMPaul DwyerJapan965
34FastGomokuWang ZhengChina957
35PisqMartin PetricekCzech Republic938
36DjallLadislav PetrCzech Republic904
37LeonardoMilan MatlakCzech Republic891
38BenjaminBenjamin VejnarCzech Republic862
39AIJan MacuraCzech Republic837
40ValkyrieTakashi KokubunJapan822
41StahlfaustMarco Kunze
Sebastian Nowozin
Germany807
42FiveRowYaroslavUkraine773
43CurnpisJan CurnCzech Republic728
44PureRockyPaul DwyerJapan727
45CrusherNils BeckmannGermany669
46PrologDavid MacekCzech Republic610
47MushroomChen KaiChina416

|- style="vertical-align: top;"

|

class="wikitable"

|+ Elo Ratings for Standard Gomoku

RankAIAuthorCountryElo Rating
1YixinSun KaiChina2409
2RenjuSolverWen XiangdongChina1978
3SlowRenjuHao TianyiChina1958
4TitoAndrej TokarjevHungary1944
5HewerTomas KubesCzech Republic1928
6WhoseHou WenChina1665
7CarbonMichal CzardybonPoland1624
8GMotorRoman VancuraCzech Republic1595
9PelaPetr LastovickaCzech Republic1572
10ZetorTomas ChmelaCzech Republic1507

|

class="wikitable"

|+ Elo Ratings for Renju

RankAIAuthorCountryElo Rating
1YixinSun KaiChina2725
2RenjuSolverWen XiangdongChina2334
3SlowRenjuHao TianyiChina2316
4CarbonMichal CzardybonPoland2155
5XLChen ChengtaoChina1982
6PelaPetr LastovickaCzech Republic1970
7WhoseHou WenChina1927

|-

|}

Results

The results for the Gomocup tournaments since 2000 is in the following.{{Cite web|url=http://gomocup.org/results/|title=Results {{!}} Gomocup|website=Gomocup|access-date=2016-06-02}}

class="wikitable"

|+Results of Gomocup Freestyle Gomoku League (2000 - 2017) {{efn|One author is only allowed to submit one AI to each tournament since 2005.|group=f}}

! rowspan="2" |Year

! colspan="3" |1st

! colspan="3" |2nd

! colspan="3" |3rd

! rowspan="2" |Balanced

Opening

AI

!Author

!Country

!AI

!Author

!Country

!AI

!Author

!Country

2000

|Pisq 5

| Martin Petricek

| Czech Republic

|Pisq 4

| Martin Petricek

| Czech Republic

|Pisq 3

| Martin Petricek

| Czech Republic

| align=center |Not used

2001

|Pisq 5

| Martin Petricek

| Czech Republic

|Mentat

| Vojta Havranek

| Czech Republic

|Leonardo

| Milan Matlak

| Czech Republic

| align=center |Not used

2002

|Trunkat

| Jiri Trunkat

| Czech Republic

|Krysa

| Jiri Fontan

| Czech Republic

|XMentat

| Vojta Havranek

| Czech Republic

| align=center |Not used

2003

|Svine

| Jiri Fontan

| Czech Republic

|Hewer

| Tomas Kubes

| Czech Republic

|Trunkat

| Jiri Trunkat

| Czech Republic

| align=center |Not used

2004

|Svine

| Jiri Fontan

| Czech Republic

|Goro

| Victor Barykin

| Russia

|Bestmove

| Wen Xiangdong

| China

| align=center |Not used

2005

|Goro

| Victor Barykin

| Russia

|Swine

| Jiri Fontan

| Czech Republic

|Pela

| Petr Lastovicka

| Czech Republic

| align=center |Not used

2006

|Goro

| Victor Barykin

| Russia

|Tito

| Andrej Tokarjev

| Hungary

|HGarden

| Han Bingqing

| China

| align=center |Used

2007

|Tito

| Andrej Tokarjev

| Hungary

|HGarden

| Han Bingqing

| China

|Swine

| Jiri Fontan

| Czech Republic

| align=center |Used

2008

|Tito

| Andrej Tokarjev

| Hungary

|Onix

| Istvan Virag
Janos Wagner

| Hungary

|HGarden

| Han Bingqing

| China

| align=center |Used

2009

|Goro

| Victor Barykin

| Russia

|Onix

| Istvan Virag
Janos Wagner

| Hungary

|HGarden

| Han Bingqing

| China

| align=center |Used

2010

|Goro

| Victor Barykin

| Russia

|Tito

| Andrej Tokarjev

| Hungary

|Onix

| Istvan Virag
Janos Wagner

| Hungary

| align=center |Used

2011

|Tito

| Andrej Tokarjev

| Hungary

|RenjuSolver

| Wen Xiangdong

| China

|Swine

| Jiri Fontan

| Czech Republic

| align=center |Used

2012

|Yixin

| Sun Kai

| China

|RenjuSolver

| Wen Xiangdong

| China

|Hewer

| Tomas Kubes

| Czech Republic

| align=center |Used

2013

|Yixin

| Sun Kai

| China

|Tito

| Andrej Tokarjev

| Hungary

|RenjuSolver

| Wen Xiangdong

| China

| align=center |Used

2014

|Yixin

| Sun Kai

| China

|RenjuSolver

| Wen Xiangdong

| China

|Hewer

| Tomas Kubes

| Czech Republic

| align=center |Used

2015

|Yixin

| Sun Kai

| China

|RenjuSolver

| Wen Xiangdong

| China

|Tito

| Andrej Tokarjev

| Hungary

| align=center |Used

2016

|Yixin

| Sun Kai

| China

|RenjuSolver

| Wen Xiangdong

| China

|SlowRenju

| Hao Tianyi

| China

| align=center |Used

2017

|Yixin

| Sun Kai

| China

|RenjuSolver

| Wen Xiangdong

| China

|Goro

| Victor Barykin

| Russia

| align=center |Used

2018

|Yixin

| Sun Kai

| China

|RenjuSolver

| Wen Xiangdong

| China

|Goro

| Victor Barykin

| Russia

| align=center |Used

{{notelist|group=f}}

class="wikitable"

|+Results of Gomocup Fastgame (Freestyle Gomoku) League (2005 - 2017)

! rowspan="2" |Year

! colspan="3" |1st

! colspan="3" |2nd

! colspan="3" |3rd

! rowspan="2" |Balanced

Opening

AI

!Author

!Country

!AI

!Author

!Country

!AI

!Author

!Country

2005

|Pela

| Petr Lastovicka

| Czech Republic

|Goro

| Victor Barykin

| Russia

|Beta

|Tomas Kubes

| Czech Republic

| align=center |Not used

2006

|Pela

| Petr Lastovicka

| Czech Republic

|Tito

| Andrej Tokarjev

| Hungary

|Goro

| Victor Barykin

| Russia

| align=center |Used

2007

|Tito

| Andrej Tokarjev

| Hungary

|HGarden

| Han Bingqing

| China

|Pela

| Petr Lastovicka

| Czech Republic

| align=center |Used

2008

|Tito

| Andrej Tokarjev

| Hungary

|HGarden

| Han Bingqing

| China

|Hewer

| Tomas Kubes

| Czech Republic

| align=center |Used

2009

|Hewer

| Tomas Kubes

| Czech Republic

|HGarden

| Han Bingqing

| China

|Kanec

| Jaroslav Babak

| Czech Republic

| align=center |Used

2010

|Goro

| Victor Barykin

| Russia

|Hewer

| Tomas Kubes

| Czech Republic

|Tito

| Andrej Tokarjev

| Hungary

| align=center |Used

2011

|Swine

| Jiri Fontan

| Czech Republic

|Tito

| Andrej Tokarjev

| Hungary

|RenjuSolver

| Wen Xiangdong

| China

| align=center |Used

2012

|Hewer

| Tomas Kubes

| Czech Republic

|Yixin

| Sun Kai

| China

|Swine

| Jiri Fontan

| Czech Republic

| align=center |Used

2013

|Yixin

| Sun Kai

| China

|Hewer

| Tomas Kubes

| Czech Republic

|HGarden

| Han Bingqing

| China

| align=center |Used

2014

|Yixin

| Sun Kai

| China

|Goro

| Victor Barykin

| Russia

|Hewer

| Tomas Kubes

| Czech Republic

| align=center |Used

2015

|Yixin

| Sun Kai

| China

|Goro

| Victor Barykin

| Russia

|Hewer

| Tomas Kubes

| Czech Republic

| align=center |Used

2016

|Yixin

| Sun Kai

| China

|Goro

| Victor Barykin

| Russia

|SlowRenju

| Hao Tianyi

| China

| align=center |Used

2017

|Yixin

| Sun Kai

| China

|Goro

| Victor Barykin

| Russia

|Hewer

| Tomas Kubes

| Czech Republic

| align=center |Used

class="wikitable"

|+Results of Gomocup Standard Gomoku League (2009 - 2017) {{efn|The result of standard Gomoku is not accurate due to technical problems in 2009 and 2010.|group=r}}

! rowspan="2" |Year

! colspan="3" |1st

! colspan="3" |2nd

! colspan="3" |3rd

! rowspan="2" |Balanced

Opening

AI

!Author

!Country

!AI

!Author

!Country

!AI

!Author

!Country

2009

|Hewer

| Tomas Kubes

| Czech Republic

|Pela

| Petr Lastovicka

| Czech Republic

| colspan="3" align=center | -

| align=center |Used

2010

|Hewer

| Tomas Kubes

| Czech Republic

|Tito

| Andrej Tokarjev

| Hungary

|Pela

| Petr Lastovicka

| Czech Republic

| align=center |Used

2011

|Tito

| Andrej Tokarjev

| Hungary

|Hewer

| Tomas Kubes

| Czech Republic

|GMotor

| Roman Vancura

| Czech Republic

| align=center |Used

2012

|Hewer

| Tomas Kubes

| Czech Republic

|Tito

| Andrej Tokarjev

| Hungary

|Yixin

| Sun Kai

| China

| align=center |Used

2013

|Yixin

| Sun Kai

| China

|Tito

| Andrej Tokarjev

| Hungary

|Hewer

| Tomas Kubes

| Czech Republic

| align=center |Used

2014

|Tito

| Andrej Tokarjev

| Hungary

|Yixin

| Sun Kai

| China

|Hewer

| Tomas Kubes

| Czech Republic

| align=center |Used

2015

|Yixin

| Sun Kai

| China

|Tito

| Andrej Tokarjev

| Hungary

|Hewer

| Tomas Kubes

| Czech Republic

| align=center |Used

2016

|Yixin

| Sun Kai

| China

|RenjuSolver

| Wen Xiangdong

| China

|Tito

| Andrej Tokarjev

| Hungary

| align=center |Used

2017

|Yixin

| Sun Kai

| China

|RenjuSolver

| Wen Xiangdong

| China

|SlowRenju

| Hao Tianyi

| China

| align=center |Used

{{notelist|group=r}}

class="wikitable"

|+Results of Gomocup Renju League (2016 - 2017)

! rowspan="2" |Year

! colspan="3" |1st

! colspan="3" |2nd

! colspan="3" |3rd

! rowspan="2" |Balanced

Opening

AI

!Author

!Country

!AI

!Author

!Country

!AI

!Author

!Country

2016

|Yixin

| Sun Kai

| China

|RenjuSolver

| Wen Xiangdong

| China

|SlowRenju

| Hao Tianyi

| China

| align=center |Used

2017

|Yixin

| Sun Kai

| China

|RenjuSolver

| Wen Xiangdong

| China

|SlowRenju

| Hao Tianyi

| China

| align=center |Used

References