Size: a a a

2020 August 06

DS

Dmitry Sharonov in Tarantool
в инитлуа
источник

DS

Dmitry Sharonov in Tarantool
его кажется надо себе украсть
источник

AS

Alexander Susin in Tarantool
Мое приложение:

Membership encryption enabled
DNS resolution has been failed. Trying to probe it again...
Could not reach node: protlevel-storage-0-0.protlevel-cluster:3301 - suspect
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
Node timed out: protlevel-storage-0-0.protlevel-cluster:3301 - dead
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
Refuting the rumor that we are dead
Box option 'work_dir' is deprecated. Please, dont't use it
Using advertise_uri "test-storage-0-0.protlevel-cluster:3301"
Membership encryption enabled
Membership BROADCAST sent to 127.0.0.1:3302
Membership BROADCAST sent to 10.42.4.63:3302
Membership BROADCAST sent to 127.0.0.1:3301
Membership BROADCAST sent to 10.42.4.63:3301
Membership BROADCAST sent to 127.0.0.1:3300
Membership BROADCAST sent to 10.42.4.63:3300
started
Listening HTTP on 0.0.0.0:8080
started
Remote control bound to 0.0.0.0:3301
Remote control ready to accept connections
Instance state changed:  -> Unconfigured
entering the event loop
источник

DS

Dmitry Sharonov in Tarantool
как раз из за днсов
источник

AS

Alexander Susin in Tarantool
Dmitry Sharonov
в тестовом приложении самопинг еще зашит вроде
Хм, вроде взял прям init.lua из теста, немного модифицировал его под себя, но результат тот же.
источник

AS

Alexander Susin in Tarantool
Можете показать кусок кода, который за этот функционал отвечает?
источник

DS

Dmitry Sharonov in Tarantool
а, ну может он дождался уже к концу лога
источник

DS

Dmitry Sharonov in Tarantool
Alexander Susin
Мое приложение:

Membership encryption enabled
DNS resolution has been failed. Trying to probe it again...
Could not reach node: protlevel-storage-0-0.protlevel-cluster:3301 - suspect
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
Node timed out: protlevel-storage-0-0.protlevel-cluster:3301 - dead
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
Refuting the rumor that we are dead
Box option 'work_dir' is deprecated. Please, dont't use it
Using advertise_uri "test-storage-0-0.protlevel-cluster:3301"
Membership encryption enabled
Membership BROADCAST sent to 127.0.0.1:3302
Membership BROADCAST sent to 10.42.4.63:3302
Membership BROADCAST sent to 127.0.0.1:3301
Membership BROADCAST sent to 10.42.4.63:3301
Membership BROADCAST sent to 127.0.0.1:3300
Membership BROADCAST sent to 10.42.4.63:3300
started
Listening HTTP on 0.0.0.0:8080
started
Remote control bound to 0.0.0.0:3301
Remote control ready to accept connections
Instance state changed:  -> Unconfigured
entering the event loop
а что не так с этим логом? он поднялся
источник

AS

Alexander Susin in Tarantool
Вот логи тестового, и тут видно разницу (в моем
Unconfigured
последнее состояние)

Membership encryption enabled
Could not reach node: storage-0-0.examples-kv-cluster:3301 - suspect
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
Node timed out: storage-0-0.examples-kv-cluster:3301 - dead
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
Refuting the rumor that we are dead
Using advertise_uri "storage-0-0.examples-kv-cluster:3301"
Membership encryption enabled
Membership BROADCAST sent to 127.0.0.1:3302
Membership BROADCAST sent to 10.42.4.64:3302
Membership BROADCAST sent to 127.0.0.1:3301
Membership BROADCAST sent to 10.42.4.64:3301
Membership BROADCAST sent to 127.0.0.1:3300
Membership BROADCAST sent to 10.42.4.64:3300
started
Listening HTTP on 0.0.0.0:8081
Ready for bootstrap
entering the event loop
Config downloaded from membership
Bootstrapping box.cfg...
2020-08-06 12:49:11.247 [1] main/109/lua C> Tarantool 1.10.7-1-gb93a33a
2020-08-06 12:49:11.248 [1] main/109/lua C> log level 5
2020-08-06 12:49:11.248 [1] main/109/lua I> mapping 33554432 bytes for memtx tuple arena...
2020-08-06 12:49:11.248 [1] main/109/lua I> mapping 134217728 bytes for vinyl tuple arena...
2020-08-06 12:49:11.256 [1] main/109/lua I> instance uuid 497762e2-02a1-583e-8f51-5610375ebae9
2020-08-06 12:49:11.257 [1] iproto/101/main I> binary: bound to 0.0.0.0:3301
2020-08-06 12:49:11.257 [1] main/109/lua I> connecting to 1 replicas
2020-08-06 12:49:11.264 [1] main/114/applier/admin@storage-0-0.examp I> remote master 497762e2-02a1-583e-8f51-5610375ebae9 at 10.42.4.64:3301 running Tarantool 1.10.7
2020-08-06 12:49:11.265 [1] main/109/lua I> connected to 1 replicas
2020-08-06 12:49:11.265 [1] main/109/lua I> initializing an empty data directory
2020-08-06 12:49:11.275 [1] main/109/lua I> assigned id 1 to replica 497762e2-02a1-583e-8f51-5610375ebae9
2020-08-06 12:49:11.275 [1] main/109/lua I> cluster uuid 05e42b64-fa81-59e6-beb2-95d84c22a435
2020-08-06 12:49:11.277 [1] snapshot/101/main I> saving snapshot `/var/lib/tarantool/00000000000000000000.snap.inprogress'
2020-08-06 12:49:11.285 [1] snapshot/101/main I> done
источник

AS

Alexander Susin in Tarantool
Dmitry Sharonov
а, ну может он дождался уже к концу лога
тут не совсем понял.
источник

DS

Dmitry Sharonov in Tarantool
ну то есть с днсами все хорошо
источник

DS

Dmitry Sharonov in Tarantool
Alexander Susin
Вот логи тестового, и тут видно разницу (в моем
Unconfigured
последнее состояние)

Membership encryption enabled
Could not reach node: storage-0-0.examples-kv-cluster:3301 - suspect
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
Node timed out: storage-0-0.examples-kv-cluster:3301 - dead
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
DNS resolution has been failed. Trying to probe it again...
Refuting the rumor that we are dead
Using advertise_uri "storage-0-0.examples-kv-cluster:3301"
Membership encryption enabled
Membership BROADCAST sent to 127.0.0.1:3302
Membership BROADCAST sent to 10.42.4.64:3302
Membership BROADCAST sent to 127.0.0.1:3301
Membership BROADCAST sent to 10.42.4.64:3301
Membership BROADCAST sent to 127.0.0.1:3300
Membership BROADCAST sent to 10.42.4.64:3300
started
Listening HTTP on 0.0.0.0:8081
Ready for bootstrap
entering the event loop
Config downloaded from membership
Bootstrapping box.cfg...
2020-08-06 12:49:11.247 [1] main/109/lua C> Tarantool 1.10.7-1-gb93a33a
2020-08-06 12:49:11.248 [1] main/109/lua C> log level 5
2020-08-06 12:49:11.248 [1] main/109/lua I> mapping 33554432 bytes for memtx tuple arena...
2020-08-06 12:49:11.248 [1] main/109/lua I> mapping 134217728 bytes for vinyl tuple arena...
2020-08-06 12:49:11.256 [1] main/109/lua I> instance uuid 497762e2-02a1-583e-8f51-5610375ebae9
2020-08-06 12:49:11.257 [1] iproto/101/main I> binary: bound to 0.0.0.0:3301
2020-08-06 12:49:11.257 [1] main/109/lua I> connecting to 1 replicas
2020-08-06 12:49:11.264 [1] main/114/applier/admin@storage-0-0.examp I> remote master 497762e2-02a1-583e-8f51-5610375ebae9 at 10.42.4.64:3301 running Tarantool 1.10.7
2020-08-06 12:49:11.265 [1] main/109/lua I> connected to 1 replicas
2020-08-06 12:49:11.265 [1] main/109/lua I> initializing an empty data directory
2020-08-06 12:49:11.275 [1] main/109/lua I> assigned id 1 to replica 497762e2-02a1-583e-8f51-5610375ebae9
2020-08-06 12:49:11.275 [1] main/109/lua I> cluster uuid 05e42b64-fa81-59e6-beb2-95d84c22a435
2020-08-06 12:49:11.277 [1] snapshot/101/main I> saving snapshot `/var/lib/tarantool/00000000000000000000.snap.inprogress'
2020-08-06 12:49:11.285 [1] snapshot/101/main I> done
ага, то есть шаги которые про сборку кластера дальше не триггернулись
источник

DS

Dmitry Sharonov in Tarantool
@vasiliy_tyubek идеи?
источник

AS

Alexander Susin in Tarantool
Dmitry Sharonov
ага, то есть шаги которые про сборку кластера дальше не триггернулись
Да, именно так.
источник

AS

Alexander Susin in Tarantool
Скину свой init.lua сейчас.
источник

AS

Alexander Susin in Tarantool
#!/usr/bin/env tarantool

require('strict').on()



-- This is necessary so that we can start init.lua
-- even when we are not in the same directory with it
local script_dir = debug.getinfo(1, "S").source:sub(2):match("(.*/)") or './'
dofile(script_dir ..'/env.lua')

local log = require('log')
local cartridge = require('cartridge')
local console = require('console')
local fiber = require('fiber')

local work_dir = os.getenv("TARANTOOL_WORK_DIR") or '.'
local instance_name = os.getenv("TARANTOOL_INSTANCE_NAME")
local console_sock = os.getenv("TARANTOOL_CONSOLE_SOCK")
local advertise_uri = os.getenv("TARANTOOL_ADVERTISE_URI")
local memtx_memory = tonumber(os.getenv("TARANTOOL_MEMTX_MEMORY")) or (128 * 1024 * 1024)

local http_port = os.getenv("TARANTOOL_HTTP_PORT") or 8080

local log = require('log')

--- [HACK] Probing node via membership
local function dns_resolver(opts)
   opts = opts or {}
   opts.timeout = opts.timeout or 100

   local membership = require('membership')

   local hostname, port = advertise_uri:match("^(.*)%:(.*)")
   local ok, err = membership.init(hostname, tonumber(port))
   if not ok then
       log.error("[dns_resolver] Can't init a membership. Error: %s", err)
       os.exit(1)
   end

   membership.set_encryption_key('test')
   membership.set_payload('alias', '__' .. advertise_uri)

   local time = 0
   local resolved = false
   while time < opts.timeout do
       local ok = membership.probe_uri(membership.myself().uri)
       if ok then
           resolved = true
           break
       end

       log.info("DNS resolution has been failed. Trying to probe it again...")
       fiber.sleep(1)
       time = time + 1
   end

   membership.leave()
   if not resolved then
       return false
   end

   return true
end

local resolved = dns_resolver({ timeout = 60 })
if not resolved then
   log.error("[dns_resolver] Instance has not been resolved")
   os.exit(1)
end
--- End of hack

local ok, err = cartridge.cfg({
   alias = instance_name,
   workdir = work_dir,
   advertise_uri = advertise_uri,
   cluster_cookie = 'secret-cluster-cookie',
   bucket_count = 30000,
   http_port = http_port,
   roles = {
       'cartridge.roles.vshard-storage',
       'cartridge.roles.vshard-router',
       'app.roles.api',
       'app.roles.test-1',
       'app.roles.test-2',
       'app.roles.test-3',
   },
}, {memtx_memory = memtx_memory})

assert(ok, tostring(err))

if console_sock ~= nil then
   console.listen('unix/:' .. console_sock)
end
источник

AS

Alexander Susin in Tarantool
То есть руками я могу собрать свое приложение (всмысле кластер), но хочется же что бы "магия")
источник

DS

Dmitry Sharonov in Tarantool
вы из одной ноды собираете кластерок?
источник

AS

Alexander Susin in Tarantool
нет, поднимается два пода.
storage
router
источник

DS

Dmitry Sharonov in Tarantool
на втором лог такой же?
источник