geoIP script for AC 1.2

[grenadier]

GeoIP script shows name of country, from where connected chosen player.
To use it, paste below code to config/autoexec.cfg in profile and unpack .txt files to that folder from this file:
geoip_GeoLite2_AC_attachments_20191224.zip

Usage: /geoip CN , where CN is client number, for example: /geoip 4
/geoipall - show countries of the all players

Notes: database has ~2,5 MB (it isn't added to saved.cfg), script checks only first 3 octets of IP, it uses binary search algorithm, database is from https://dev.maxmind.com/geoip/geoip2/geolite2/

[SELECT ALL] Code:

// geoip script v. 4.2 by grenadier - date: 28.10.2018

// execute database of IPs
// this product includes GeoLite2 data created by MaxMind, available from http://www.maxmind.com
exec config/geoip_ipnum.txt
exec config/geoip_abbr.txt
exec config/geoip_countrylist.txt

alias geoip [
 if (= (isclient $arg1) 1) [
   if (!= (player $arg1 ip) (player1 ip)) [
     tmp_first_byte = (at (strreplace (player $arg1 ip) "." " ") 0)
     tmp_second_byte = (at (strreplace (player $arg1 ip) "." " ") 1)
     tmp_third_byte = (at (strreplace (player $arg1 ip) "." " ") 2)
     tmp_ipnum = ( + ( + ( * 65536 (tmp_first_byte) ) ( * 256 (tmp_second_byte) ) ) (tmp_third_byte) )
     
     //take IP of server for players with private IP
     if (|| (|| (&& (>= (tmp_ipnum) 655360) (<= (tmp_ipnum) 720895)) (&& (>= (tmp_ipnum) 11276288) (<= (tmp_ipnum) 11280383))) (&& (>= (tmp_ipnum) 12625920) (<= (tmp_ipnum) 12626175))) [              
       tmp_first_byte = (at (strreplace (curserver 1) "." " ") 0)
       tmp_second_byte = (at (strreplace (curserver 1) "." " ") 1)
       tmp_third_byte = (at (strreplace (curserver 1) "." " ") 2)
       tmp_ipnum = ( + ( + ( * 65536 (tmp_first_byte) ) ( * 256 (tmp_second_byte) ) ) (tmp_third_byte) )
echo 1
     ]

     i = 0
     j = 0

     persistidents 0
     alias tmp_geoip_ipnum [ getalias (concatword tmp_geoip_ipnum_ $tmp_first_byte) ]
     alias tmp_geoip_abbr [ getalias (concatword tmp_geoip_abbr_ $tmp_first_byte) ]
     persistidents 1
     
     alias tmp_length [ listlen (tmp_geoip_ipnum) ]
     alias tmp_search [ at (tmp_geoip_ipnum) (- $tmp_IP_position 1) ] //-1, because CubeScript starts from 0
     alias tmp_search_plus [ at (tmp_geoip_ipnum) $tmp_IP_position ]      

     //binary search algorithm
     while [&& (>= $i 0) (<= $j 19)][
       ++ j
       tmp_IP_position = (div (+ $i (tmp_length)) 2)  
       if (&& (>= $tmp_ipnum (tmp_search_plus)) (!= (- $tmp_IP_position $i) -1) )[ //find last country
         i = (+ $tmp_IP_position 1)
       ][
         if (< $tmp_ipnum (tmp_search))[
           tmp_length = (- $tmp_IP_position 1)        
         ][
           alias tmp_abbr (at (tmp_geoip_abbr) (- $tmp_IP_position 1)) //find country abbreviation                

           if (<= (strlen $tmp_abbr) 2)[ //if in this IP range is only 1 country
             tmp_player_country = (at $tmp_geoip_countrylist (+ (findlist $tmp_geoip_countrylist $tmp_abbr) 1) ) //find country name from abbreviation
           ][  //if in this IP range is more than 1 country
             if (= (strlen $tmp_abbr) 4)[
               tmp_player_country = ( concatword (at $tmp_geoip_countrylist (+ (findlist $tmp_geoip_countrylist (substr $tmp_abbr 0 2)) 1)) " or " (at $tmp_geoip_countrylist (+ (findlist $tmp_geoip_countrylist (substr $tmp_abbr 2 2)) 1)) )
             ][
               if (<= (strlen $tmp_abbr) 6)[
                 tmp_player_country = ( concatword (at $tmp_geoip_countrylist (+ (findlist $tmp_geoip_countrylist (substr $tmp_abbr 0 2)) 1)) " or " (at $tmp_geoip_countrylist (+ (findlist $tmp_geoip_countrylist (substr $tmp_abbr 2 2)) 1)) " or " (at $tmp_geoip_countrylist (+ (findlist $tmp_geoip_countrylist (substr $tmp_abbr 4 2)) 1)) )
               ][
                 tmp_player_country = (concatword "one of " (div (strlen $tmp_abbr) 2) " countries")
               ]
             ]
           ]          
           break          
         ]
       ]
     ] //end of binary search algorithm

     if (= $j 20) [tmp_player_country = "nowhere"]
     if (= $arg2 1) [tmp_player_ip = ""][tmp_player_ip = (concatword (c Y) "(" (player $arg1 ip) ")")]
     echo (c Y) (player $arg1 name) (c Y) (concatword "(" $arg1 ")") (c Y) "connected from" (c Y) $tmp_player_country $tmp_player_ip
   ][
     echo "geoIP info: this client number" $arg1 "is your number"
   ]
 ][
   echo "geoIP info: this client number" $arg1 "isn't valid"
 ]
]

alias "geoipall" [ loop i (curplayers) [if (&& (= (isclient $i) 1) (!= $i (player1 cn))) [ geoip $i $arg1]] ]

Note: if you want to use the last version of abandoned GeoLite database from https://dev.maxmind.com/geoip/legacy/geolite/ instead of newer GeoLite2 database, please use the attachments from the following package: geoip_AC_attachments_2018_03_27.zip

[grenadier]

Instruction for preparing geoip database for geoip script (for Linux):

I. Instruction for GeoLite2 database by MaxMind:

Spoiler

1. Download GeoLite2 Country CSV database from GeoLite2 Free Downloadable Databases (GeoLite2 Country), unzip it.

2. Prepare list of country abbreviations with assigned countries (a - convert non-ASCII letters to ASCII, b - remove first line, c - print country abbreviations and names, d - add anonymous proxy):

[SELECT ALL] Code:

a) iconv -f UTF8 -t US-ASCII//TRANSLIT GeoLite2-Country-Locations-en.csv > copy_GeoLite2-Country-Locations-en.csv
b) sed -i '1d' copy_GeoLite2-Country-Locations-en.csv
c) awk 'BEGIN {FPAT="([^,]+)|(\"[^\"]+\")"} {print $(NF-2), $(NF-1)}' copy_GeoLite2-Country-Locations-en.csv |sort > geoip_countrylist_temp.txt
d) echo "AA \"Anonymous proxy\"" >> geoip_countrylist_temp.txt
e) awk 'BEGIN {print "persistidents 0"; print "const tmp_geoip_countrylist ["} {print $0} END{print "]"; print "persistidents 1"}' geoip_countrylist_temp.txt > geoip_countrylist.txt

3. Print CIDR and country id, remove satellite providers, and remove first line (b):

[SELECT ALL] Code:

a) awk 'BEGIN {FPAT="([^,]+)|(\"[^\"]+\")"} {if(! $NF) {if(! $(NF-1)) {print $1, $2} else {print $1, "1234"} }}' GeoLite2-Country-Blocks-IPv4.csv > copy_GeoLite2-Country-Blocks-IPv4.csv
b) sed -i '1d' copy_GeoLite2-Country-Blocks-IPv4.csv

4. Replace country id by country abbreviation:

[SELECT ALL] Code:

a) awk 'BEGIN {FPAT="([^,]+)|(\"[^\"]+\")"} {print $1, $(NF-2)}' copy_GeoLite2-Country-Locations-en.csv > geoip_countrylist_temp.txt
b) echo "1234 AA" >> geoip_countrylist_temp.txt
c) awk 'FNR==NR{a[$1]=$2;next} {($2 in a)sub($2, a[$2]); print}' geoip_countrylist_temp.txt copy_GeoLite2-Country-Blocks-IPv4.csv > copy2_GeoLite2-Country-Blocks-IPv4.csv

5. Add last IP in CIDR range (c - combine 2 files, d - remove dots):

[SELECT ALL] Code:

a) awk '{print $1}' copy_GeoLite2-Country-Blocks-IPv4.csv > endIPrange.txt
b) sipcalc - < endIPrange.txt |awk '/Broadcast address/{print $4}' > endIPrange2.txt
c) paste -d" " copy2_GeoLite2-Country-Blocks-IPv4.csv endIPrange2.txt > copy_GeoLite2-Country-Blocks-IPv4.csv
d) vim "+%s/\./\ /g" "+wq" copy_GeoLite2-Country-Blocks-IPv4.csv

6. Calculate ipnum:

[SELECT ALL] Code:

awk '{print $1, $2, $3, $6, $7, $8, (65536 * $1 + 256 * $2 + $3), $5}' copy_GeoLite2-Country-Blocks-IPv4.csv > copy2_GeoLite2-Country-Blocks-IPv4.csv

7. a - separate range common for two 3-octets ranges, b - divide range for ranges started from different first octets, c & d - remove duplicates:

[SELECT ALL] Code:

a) awk 'BEGIN {ipnum_p=0; first_p=0; second_p=0; third_p=0; abbr_p=0} {if ($7!=ipnum_p) {if ($1==first_p && $2==second_p && $3==third_p) {print $1, $2, $3, $1, $2, $3, $7, abbr_p; print $1, $2, $3, $1, $2, $3, $7, $8; if ($3!=255) {print $1, $2, $3+1, $4, $5, $6, $7+1, $8} else {a=$1; b=$2+1; if ($2==255) {a=$1+1; b=0}; print a, b, 0, $4, $5, $6, a*65536+b*256, $8}} else {print $0}} else if ($4==first_p && $5==second_p && $6==third_p) {print $0} else {print $1, $2, $3, $1, $2, $3, $7, $8; if ($3!=255) {print $1, $2, $3+1, $4, $5, $6, $7+1, $8} else {a=$1; b=$2+1; if ($2==255) {a=$1+1; b=0}; print a, b, 0, $4, $5, $6, a*65536+b*256, $8}}; first_p=$4; second_p=$5; third_p=$6; ipnum_p=$7; abbr_p=$8}' copy2_GeoLite2-Country-Blocks-IPv4.csv > copy_GeoLite2-Country-Blocks-IPv4.csv
b) awk '{if ($1==$4) {print $0} else {print $1, $2, $3, $1, 255, 255, $7, $8; for (i=$1+1; i<=$4; i++) {if ($4-i>=1) {print i, 0, 0, i, 255, 255, i*65536, $8 } else {print $4, 0, 0, $4, $5, $6, $4*65536, $8}}}}' copy_GeoLite2-Country-Blocks-IPv4.csv > copy2_GeoLite2-Country-Blocks-IPv4.csv
c) sort -n -k 7 copy2_GeoLite2-Country-Blocks-IPv4.csv > copy_GeoLite2-Country-Blocks-IPv4.csv
d) uniq -f 6 copy_GeoLite2-Country-Blocks-IPv4.csv > copy2_GeoLite2-Country-Blocks-IPv4.csv

8. Assign all countries from the same range to one ipnum, print ipnum and country abbreviations to separate files:

[SELECT ALL] Code:

a) awk '{x = sprintf("%s %s %s %s %s %s %s", $1, $2, $3, $4, $5, $6, $7); if(x in a) a[x]=sprintf("%s%s", a[x], $8); else a[x]=$8} END {for (k in a) {print k, a[k] } }' copy2_GeoLite2-Country-Blocks-IPv4.csv| sort -n -k 7 > copy_GeoLite2-Country-Blocks-IPv4.csv
b) awk 'BEGIN {a=1; print "persistidents 0"; print "const tmp_geoip_ipnum_1 ["} {if ($1==a) {print $7} else {a=$1; print "]"; print "const tmp_geoip_ipnum_" a " ["; print $7}} END{print "]"; print "persistidents 1"}' copy_GeoLite2-Country-Blocks-IPv4.csv > geoip_ipnum.txt
c) awk 'BEGIN {a=1; print "persistidents 0"; print "const tmp_geoip_abbr_1 ["} {if ($1==a) {print $8} else {a=$1; print "]"; print "const tmp_geoip_abbr_" a " ["; print $8}} END{print "]"; print "persistidents 1"}' copy_GeoLite2-Country-Blocks-IPv4.csv > geoip_abbr.txt

9. Remove temporary files

[SELECT ALL] Code:

rm -f copy*.csv  geoip_countrylist_temp.txt endIPrange*.txt

II. Instruction for abandoned GeoLite database by MaxMind:

Spoiler

1. Download GeoLite Country CSV database from https://dev.maxmind.com/geoip/legacy/geolite/ ( http://geolite.maxmind.com/download/geoi...tryCSV.zip)

2. Unzip GeoIPCountryCSV.zip and make copy of GeoIPCountryWhois.csv file:

[SELECT ALL] Code:

cp GeoIPCountryWhois.csv copy_GeoIPCountryWhois.csv

3. Delete comas:

[SELECT ALL] Code:

vim "+%s/\,/\ /g" "+wq" copy_GeoIPCountryWhois.csv

4. Prepare list of country abbreviations with assigned countries (Sattelite Provider is removed) and remove useless white spaces:

[SELECT ALL] Code:

a) awk '$5!="\"A2\"" {print $5 " " $6 " " $7 " " $8 " " $9 " " $10 " " $11 " " $12 " " $13 " "  $14 " " $15}' copy_GeoIPCountryWhois.csv |sort |uniq > geoip_countrylist_temp.txt
b) vim "+%s/\s\{2,}//" "+wq" geoip_countrylist_temp.txt
c) awk 'BEGIN {print "persistidents 0"; print "const tmp_geoip_countrylist ["} {print $0} END{print "]"; print "persistidents 1"}' geoip_countrylist_temp.txt > geoip_countrylist.txt

5. Isolate IP of ranges and country abbreviation:

[SELECT ALL] Code:

awk '{print $1, $5, $2}' copy_GeoIPCountryWhois.csv > copy2_GeoIPCountryWhois.csv

6. Remove dots and quotation marks:

[SELECT ALL] Code:

vim "+%s/\./\ /g" "+%s/\"\ \"/\ /g" "+%s/\"//g" "+wq" copy2_GeoIPCountryWhois.csv

7. Calculate ipnum:

[SELECT ALL] Code:

awk '{print (65536 * $1 + 256 * $2 + $3), $1, $2, $3, $6, $7, $8, $5}' copy2_GeoIPCountryWhois.csv > copy_GeoIPCountryWhois.csv

8. Remove ranges of "Satellite Providers" and change order:

[SELECT ALL] Code:

a) awk '$8!="A2" {print $0}' copy_GeoIPCountryWhois.csv > copy2_GeoIPCountryWhois.csv
b) awk '{print $2, $3, $4, $5, $6, $7, $1, $8}' copy2_GeoIPCountryWhois.csv > copy_GeoIPCountryWhois.csv

9. a - separate range common for two 3-octets ranges, b - divide range for ranges started from different first octets, c & d - remove duplicates:

[SELECT ALL] Code:

a) awk 'BEGIN {ipnum_p=0; first_p=0; second_p=0; third_p=0; abbr_p=0} {if ($7!=ipnum_p) {if ($1==first_p && $2==second_p && $3==third_p) {print $1, $2, $3, $1, $2, $3, $7, abbr_p; print $1, $2, $3, $1, $2, $3, $7, $8; if ($3!=255) {print $1, $2, $3+1, $4, $5, $6, $7+1, $8} else {a=$1; b=$2+1; if ($2==255) {a=$1+1; b=0}; print a, b, 0, $4, $5, $6, a*65536+b*256, $8}} else {print $0}} else if ($4==first_p && $5==second_p && $6==third_p) {print $0} else {print $1, $2, $3, $1, $2, $3, $7, $8; if ($3!=255) {print $1, $2, $3+1, $4, $5, $6, $7+1, $8} else {a=$1; b=$2+1; if ($2==255) {a=$1+1; b=0}; print a, b, 0, $4, $5, $6, a*65536+b*256, $8}}; first_p=$4; second_p=$5; third_p=$6; ipnum_p=$7; abbr_p=$8}' copy_GeoIPCountryWhois.csv > copy2_GeoIPCountryWhois.csv
b) awk '{if ($1==$4) {print $0} else {print $1, $2, $3, $1, 255, 255, $7, $8; for (i=$1+1; i<=$4; i++) {if ($4-i>=1) {print i, 0, 0, i, 255, 255, i*65536, $8 } else {print $4, 0, 0, $4, $5, $6, $4*65536, $8}}}}' copy2_GeoIPCountryWhois.csv > copy_GeoIPCountryWhois.csv
c) sort -n -k 7 copy_GeoIPCountryWhois.csv > copy2_GeoIPCountryWhois.csv
d) uniq -f 6 copy2_GeoIPCountryWhois.csv > copy_GeoIPCountryWhois.csv

10. Assign all countries from the same range to one ipnum, print ipnum and country abbreviations to separate files:

[SELECT ALL] Code:

a) awk '{x = sprintf("%s %s %s %s %s %s %s", $1, $2, $3, $4, $5, $6, $7); if(x in a) a[x]=sprintf("%s%s", a[x], $8); else a[x]=$8} END {for (k in a) {print k, a[k] } }' copy_GeoIPCountryWhois.csv | sort -n -k 7 > copy2_GeoIPCountryWhois.csv
b) awk 'BEGIN {a=1; print "persistidents 0"; print "const tmp_geoip_ipnum_1 ["} {if ($1==a) {print $7} else {a=$1; print "]"; print "const tmp_geoip_ipnum_" a " ["; print $7}} END{print "]"; print "persistidents 1"}' copy2_GeoIPCountryWhois.csv > geoip_ipnum.txt
c) awk 'BEGIN {a=1; print "persistidents 0"; print "const tmp_geoip_abbr_1 ["} {if ($1==a) {print $8} else {a=$1; print "]"; print "const tmp_geoip_abbr_" a " ["; print $8}} END{print "]"; print "persistidents 1"}' copy2_GeoIPCountryWhois.csv > geoip_abbr.txt

11. Remove temporary files

[SELECT ALL] Code:

rm -f copy_GeoIPCountryWhois.csv copy2_GeoIPCountryWhois.csv geoip_countrylist_temp.txt

[D3M0NW0LF]

I'm glad to see this being updated finally after all this time. Thank you grenadier! :)

Spoiler

Btw if you do decide to convert those txt files to cfg you can save a few spaces and replace your exec commands with:

[SELECT ALL] Code:

run geoip_ipnum
run geoip_abbr
run geoip_countrylist

Since run looks in the config folder directly, it also knows the extension is set to .cfg

[grenadier]

Only database is updated, but I posted the script here, because Akimbo is down, and it can help to recognize impersonators (btw impersonator can be also from the same country what "true" player).

PS. It seems to me that I used .txt extension for database intentionally, in order to they will be different than .cfg files with the scripts. :)

[grenadier]

I just updated the geoip database - it is now from GeoLite2 database from 23.10.2018.
You don't have to upgrade the script in autoexec.cfg, the only change in v. 4.2 are credits and colours when player can be from more than one country.

PS. Previously used GeoLite is abandoned by MaxMind (last version of GeoLite is from 27.03.2018), I left it in the first post.

[grenadier]

The geoip database became updated, it's is from GeoLite2 database from 24.12.2019.
You don't have to upgrade the script in autoexec.cfg.