IPv6 support #3

pandax381 · 2015-05-27T07:25:16Z

Implement IPv6 support.

$ ./fluent-bit -V -i cpu -o fluentd://[::1]:12224
Fluent-Bit v0.1.0
Copyright (C) Treasure Data

[2015/05/27 00:24:43] [ info] Configuration
 flush time     : 5 seconds
 input plugins  : cpu 
 collectors     : [cpu 1s,0ns] 
[2015/05/27 00:24:43] [ info] starting engine
[2015/05/27 00:24:44] [debug] [in_cpu] CPU 1.00% (buffer=0)
[2015/05/27 00:24:45] [debug] [in_cpu] CPU 0.00% (buffer=1)
[2015/05/27 00:24:46] [debug] [in_cpu] CPU 0.00% (buffer=2)
[2015/05/27 00:24:47] [debug] [in_cpu] CPU 0.00% (buffer=3)
[2015/05/27 00:24:48] [ info] Flush buf 97 bytes
[2015/05/27 00:24:48] [debug] [in_cpu] CPU 0.00% (buffer=0)
[2015/05/27 00:24:49] [debug] [in_cpu] CPU 2.00% (buffer=1)
[2015/05/27 00:24:50] [debug] [in_cpu] CPU 0.00% (buffer=2)
[2015/05/27 00:24:51] [debug] [in_cpu] CPU 0.00% (buffer=3)
[2015/05/27 00:24:52] [debug] [in_cpu] CPU 0.00% (buffer=4)
[2015/05/27 00:24:53] [ info] Flush buf 117 bytes
[2015/05/27 00:24:53] [debug] [in_cpu] CPU 0.00% (buffer=0)
[2015/05/27 00:24:54] [debug] [in_cpu] CPU 0.00% (buffer=1)
[2015/05/27 00:24:55] [debug] [in_cpu] CPU 0.00% (buffer=2)
[2015/05/27 00:24:56] [debug] [in_cpu] CPU 0.00% (buffer=3)
[2015/05/27 00:24:57] [debug] [in_cpu] CPU 0.00% (buffer=4)
[2015/05/27 00:24:58] [ info] Flush buf 117 bytes

Signed-off-by: Masaya YAMAMOTO <pandax381@gmail.com>

IPv6 support

edsiper · 2015-05-27T15:04:21Z

thanks!

Signed-off-by: Fujimoto Seiji <fujimoto@clear-code.com>

Doc: fix typo and update execution result

When Fluent Bit encounters with a partial parser definition, it crashes badly with a segmentation fault. $ ./bin/fluent-bit -R parser.conf -c tail.conf ... [2020/01/15 16:11:21] [error] [parser] no parser 'format' found for 'simple' in file 'conf/timestamp.parser' [engine] caught signal (SIGSEGV) #0 0x558bc4a0a226 in flb_parser_decoder_list_destroy() at src/flb_parser_decoder.c:700 fluent#1 0x558bc4a05d75 in flb_parser_conf_file() at src/flb_parser.c:566 fluent#2 0x558bc49f4bdd in flb_config_set_property() at src/flb_config.c:406 fluent#3 0x558bc49e24ae in flb_service_conf() at src/fluent-bit.c:446 fluent#4 0x558bc49e2f90 in main() at src/fluent-bit.c:807 fluent#5 0x7fa1cb7f109a in ???() at ???:0 fluent#6 0x558bc49e13a9 in ???() at ???:0 fluent#7 0xffffffffffffffff in ???() at ???:0 Aborted This is just because `decoders` is not being initialized properly, and that confuses Fluent Bit to deallocate a random memmory block on the cleanup path. Fix it. Signed-off-by: Fujimoto Seiji <fujimoto@clear-code.com>

When Fluent Bit encounters with a partial parser definition, it crashes badly with a segmentation fault. $ ./bin/fluent-bit -R parser.conf -c tail.conf ... [2020/01/15 16:11:21] [error] [parser] no parser 'format' found for 'simple' in file 'conf/timestamp.parser' [engine] caught signal (SIGSEGV) #0 0x558bc4a0a226 in flb_parser_decoder_list_destroy() at src/flb_parser_decoder.c:700 #1 0x558bc4a05d75 in flb_parser_conf_file() at src/flb_parser.c:566 #2 0x558bc49f4bdd in flb_config_set_property() at src/flb_config.c:406 #3 0x558bc49e24ae in flb_service_conf() at src/fluent-bit.c:446 #4 0x558bc49e2f90 in main() at src/fluent-bit.c:807 #5 0x7fa1cb7f109a in ???() at ???:0 #6 0x558bc49e13a9 in ???() at ???:0 #7 0xffffffffffffffff in ???() at ???:0 Aborted This is just because `decoders` is not being initialized properly, and that confuses Fluent Bit to deallocate a random memmory block on the cleanup path. Fix it. Signed-off-by: Fujimoto Seiji <fujimoto@clear-code.com>

Integ Test: Run clean before the validation and use the `bash` shell

…es strictly Without this check, the following weird error is occurred intermittently: ```log [0] dummy.0: [1664938706.407551000, {"message"=>"dummy"}] [2022/10/05 11:58:27] [ info] [test] flush record flb-rt-core_chunk_trace(32205,0x16fe87000) malloc: *** error for object 0x600002600074: pointer being realloc'd was not allocated flb-rt-core_chunk_trace(32205,0x16fe87000) malloc: *** set a breakpoint in malloc_error_break to debug ``` The main reason is, num_records index is broken in some cases: ``` flb-rt-core_chunk_trace(32205,0x16fe87000) malloc: *** error for object 0x600002600074: pointer being realloc'd was not allocated flb-rt-core_chunk_trace(32205,0x16fe87000) malloc: *** set a breakpoint in malloc_error_break to debug [2022/10/05 11:58:27] [ info] [input] pausing dummy.0 Process 32205 stopped * thread #2, name = 'flb-pipeline', stop reason = breakpoint 1.1 frame #0: 0x00000001b34a3120 libsystem_malloc.dylib`malloc_error_break libsystem_malloc.dylib`malloc_error_break: -> 0x1b34a3120 <+0>: pacibsp 0x1b34a3124 <+4>: stp x29, x30, [sp, #-0x10]! 0x1b34a3128 <+8>: mov x29, sp 0x1b34a312c <+12>: nop Target 0: (flb-rt-core_chunk_trace) stopped. (lldb) bt * thread #2, name = 'flb-pipeline', stop reason = breakpoint 1.1 * frame #0: 0x00000001b34a3120 libsystem_malloc.dylib`malloc_error_break frame #1: 0x00000001b3494844 libsystem_malloc.dylib`malloc_vreport + 428 frame #2: 0x00000001b3497f34 libsystem_malloc.dylib`malloc_report + 64 frame #3: 0x00000001b3488210 libsystem_malloc.dylib`realloc + 328 frame #4: 0x0000000100006154 flb-rt-core_chunk_trace`flb_realloc(ptr=0x0000600002600074, size=18446744064764412176) at flb_mem.h:94:12 frame #5: 0x0000000100005fc8 flb-rt-core_chunk_trace`callback_add_record(data=0x0000600003014000, size=135, cb_data=0x0000600000004010) at core_chunk_trace.c:51:28 frame #6: 0x00000001001268b0 flb-rt-core_chunk_trace`out_lib_flush(event_chunk=0x0000600000c14000, out_flush=0x0000600001714000, i_ins=0x0000000100b09ab0, out_context=0x0000600000204a80, config=0x000000010181d200) at out_lib.c:197:9 frame #7: 0x0000000100029d70 flb-rt-core_chunk_trace`output_pre_cb_flush at flb_output.h:517:5 frame #8: 0x000000010044fa64 flb-rt-core_chunk_trace`co_switch(handle=0x000000010044fa64) at aarch64.c:133:4 (lldb) frane select 5 error: 'frane' is not a valid command. (lldb) frame select 5 frame #5: 0x0000000100005fc8 flb-rt-core_chunk_trace`callback_add_record(data=0x0000600003014000, size=135, cb_data=0x0000600000004010) at core_chunk_trace.c:51:28 48 flb_calloc(1, sizeof(struct callback_record)); 49 } else { 50 ctx->records = (struct callback_record *) -> 51 flb_realloc(ctx->records, 52 (ctx->num_records+1)*sizeof(struct callback_record)); 53 } 54 if (ctx->records == NULL) { (lldb) po ctx->records 0x0000600002600074 (lldb) po ctx->records 0x0000600002600074 (lldb) po ctx->num_records -559071216 ``` Signed-off-by: Hiroshi Hatake <hatake@calyptia.com>

# This is the 1st commit message: processor: input_metric: Prevent dangling pointer if cmt context is recreated Signed-off-by: Hiroshi Hatake <hiroshi@chronosphere.io> # This is the commit message #2: processor_labels: Follow change of the signature of metrics callback Signed-off-by: Hiroshi Hatake <hiroshi@chronosphere.io> # This is the commit message #3: processor_selector: Implement selector processor for metrics For future extensibility, we use "selector" as a name for this processor. Signed-off-by: Hiroshi Hatake <hiroshi@chronosphere.io> # This is the commit message #4: lib: Support setter for processor Signed-off-by: Hiroshi Hatake <hiroshi@chronosphere.io>

The tls variable for out_flush_params is not initialized as the flb_start function is not called during the dry run. Call flb_init directly and then shutdown the engine. configuration test is successful ================================================================= ==63633==ERROR: AddressSanitizer: attempting free on address which was not malloc()-ed: 0x0001f71b3ac0 in thread T0 #0 0x103c9f260 in wrap_free+0x98 (libclang_rt.asan_osx_dynamic.dylib:arm64e+0x53260) fluent#1 0x100179d9c in flb_free flb_mem.h:127 fluent#2 0x10017f4a0 in flb_output_exit flb_output.c:481 fluent#3 0x1001cb038 in flb_engine_shutdown flb_engine.c:1119 fluent#4 0x10010d45c in flb_destroy flb_lib.c:240 fluent#5 0x100008c40 in flb_main fluent-bit.c:1348 fluent#6 0x10000c644 in main fluent-bit.c:1456 fluent#7 0x18f11e0dc (<unknown module>) frame fluent#6: 0x000000010017f4a4 fluent-bit`flb_output_exit(config=0x0000000102b00200) at flb_output.c:481:9 478 479 params = FLB_TLS_GET(out_flush_params); 480 if (params) { -> 481 flb_free(params); 482 } 483 } Signed-off-by: Holger Hans Peter Freyther <holger@freyther.de>

The tls variable for out_flush_params is not initialized as the flb_start function is not called during the dry run. Call flb_init directly and then shutdown the engine. configuration test is successful ================================================================= ==63633==ERROR: AddressSanitizer: attempting free on address which was not malloc()-ed: 0x0001f71b3ac0 in thread T0 #0 0x103c9f260 in wrap_free+0x98 (libclang_rt.asan_osx_dynamic.dylib:arm64e+0x53260) #1 0x100179d9c in flb_free flb_mem.h:127 #2 0x10017f4a0 in flb_output_exit flb_output.c:481 #3 0x1001cb038 in flb_engine_shutdown flb_engine.c:1119 #4 0x10010d45c in flb_destroy flb_lib.c:240 #5 0x100008c40 in flb_main fluent-bit.c:1348 #6 0x10000c644 in main fluent-bit.c:1456 #7 0x18f11e0dc (<unknown module>) frame #6: 0x000000010017f4a4 fluent-bit`flb_output_exit(config=0x0000000102b00200) at flb_output.c:481:9 478 479 params = FLB_TLS_GET(out_flush_params); 480 if (params) { -> 481 flb_free(params); 482 } 483 } Signed-off-by: Holger Hans Peter Freyther <holger@freyther.de>

The tls variable for out_flush_params is not initialized as the flb_start function is not called during the dry run. Call flb_init directly and then shutdown the engine. configuration test is successful ================================================================= ==63633==ERROR: AddressSanitizer: attempting free on address which was not malloc()-ed: 0x0001f71b3ac0 in thread T0 #0 0x103c9f260 in wrap_free+0x98 (libclang_rt.asan_osx_dynamic.dylib:arm64e+0x53260) fluent#1 0x100179d9c in flb_free flb_mem.h:127 fluent#2 0x10017f4a0 in flb_output_exit flb_output.c:481 fluent#3 0x1001cb038 in flb_engine_shutdown flb_engine.c:1119 fluent#4 0x10010d45c in flb_destroy flb_lib.c:240 fluent#5 0x100008c40 in flb_main fluent-bit.c:1348 fluent#6 0x10000c644 in main fluent-bit.c:1456 fluent#7 0x18f11e0dc (<unknown module>) frame fluent#6: 0x000000010017f4a4 fluent-bit`flb_output_exit(config=0x0000000102b00200) at flb_output.c:481:9 478 479 params = FLB_TLS_GET(out_flush_params); 480 if (params) { -> 481 flb_free(params); 482 } 483 } Signed-off-by: Holger Hans Peter Freyther <holger@freyther.de> Signed-off-by: Markus Bergholz <git@osuv.de>

pandax381 added 2 commits May 27, 2015 00:32

Output: support for URI scheme syntax of IPv6 address based on RFC 3986.

17b8096

Signed-off-by: Masaya YAMAMOTO <pandax381@gmail.com>

Core: handling IPv6 address on flb_network.

a602e00

Signed-off-by: Masaya YAMAMOTO <pandax381@gmail.com>

edsiper added a commit that referenced this pull request May 27, 2015

Merge pull request #3 from pandax381/support-inet6

cb6a698

IPv6 support

edsiper merged commit cb6a698 into fluent:master May 27, 2015

pandax381 deleted the support-inet6 branch June 3, 2015 05:13

edsiper mentioned this pull request Apr 20, 2018

out_http: amd64.c:121: crash: Assertion `0' failed. #557

Closed

yonchin mentioned this pull request May 9, 2018

fluent-bit Crash at startup #584

Closed

Gabriel1688 mentioned this pull request Jun 1, 2018

How to terminate orphan management thread created by fluentbit? #614

Closed

ChitraKumarS mentioned this pull request Jul 13, 2018

SIGSEGV in msgpack_sbuffer_write #682

Closed

Gabriel1688 mentioned this pull request Aug 1, 2018

[engine] caught signal (SIGSEGV) when consecutive tcp packages are arrived via in_tcp plugin. #701

Closed

yubobo mentioned this pull request Aug 6, 2018

fluent-bit Crash at startup #704

Closed

prashantvicky mentioned this pull request Aug 28, 2018

Output plugin #721

Closed

stand-for-hope mentioned this pull request Nov 2, 2018

kafka output plugin issue #879

Closed

kushwiz mentioned this pull request Dec 4, 2018

[SIGSEV] Http_proxy not working with out_http #938

Closed

fujimotos pushed a commit to fujimotos/fluent-bit that referenced this pull request Jan 7, 2019

[fluent#3] libco: Use __declspec(thread) on MSVC

c733a40

Signed-off-by: Fujimoto Seiji <fujimoto@clear-code.com>

fujimotos pushed a commit to fujimotos/fluent-bit that referenced this pull request Jan 7, 2019

[fluent#3] libco: Use __declspec(thread) on MSVC

e5202e9

Signed-off-by: Fujimoto Seiji <fujimoto@clear-code.com>

cve-reporting mentioned this pull request Feb 25, 2019

Memory corruption in MQTT input plugin leading to crash of the server while processing crafted MQTT message #1135

Closed

sonirahul mentioned this pull request Jun 10, 2019

logs getting duplicated with foward as input #1375

Closed

fujimotos pushed a commit to fujimotos/fluent-bit that referenced this pull request Jul 22, 2019

Merge pull request fluent#3 from nokute78/doc

fbe21d1

Doc: fix typo and update execution result

maglun2 mentioned this pull request Nov 19, 2019

Polling of prometheus metrics randomly causes SIGSEGV #1755

Closed

rmacian mentioned this pull request Feb 19, 2020

scheduler corruption on high number of retries #1956

Closed

huzhou mentioned this pull request Apr 22, 2020

Fluent-bit pod generate core dump every time the pod is restarted after migrating to 1.4.2 #2127

Closed

phiremande mentioned this pull request Aug 25, 2020

SIGSEGV: when destroying connection #2497

Closed

allamand pushed a commit to allamand/fluent-bit that referenced this pull request Oct 26, 2020

Merge pull request fluent#3 from hossain-rayhan/cicd-integ-kinesis

adb8527

Integ Test: Run clean before the validation and use the `bash` shell

manojna10 mentioned this pull request Dec 18, 2020

Segfault at flb_input_chunk_destroy as failure of flb_input_chunk_get_tag() is not handled #2875

Closed

shaojielinux mentioned this pull request Dec 13, 2021

Encountered an error during s3 upload #4438

Closed

This was referenced Jan 11, 2022

Filesystem based chunk storage results in "chunk_io_locked" exception followed by fluentbit process termination #4597

Closed

Filesystem based chunk storage results in "chunk_io_locked" exception followed by fluentbit process termination #4598

Closed

This was referenced Jun 21, 2022

Crash when connection to AWS CloudWatch logs drops #5246

Closed

Fluentbit TLS SIGSEGV error kube-logging/logging-operator#1029

Closed

LHozzan mentioned this pull request Sep 20, 2022

FluentBit move fractional seconds #6073

Closed

tracyliuzw mentioned this pull request Sep 21, 2022

fluentbit not picking up file #6077

Closed

rawahars referenced this pull request in rawahars/fluent-bit Oct 24, 2022

GitBook: [#3] Modifying Log Based Metrics

24617ae

Minipada mentioned this pull request Dec 8, 2022

Use external C input plugin leads to crash on flb_config_map_set () #6519

Closed

shuishou1983 mentioned this pull request Feb 21, 2023

Output kafka avro: schema not found #4488

Closed

Valt25 mentioned this pull request Feb 22, 2023

Fleunt-Bit crashed with SIGSEV error #6897

Closed

lilhore mentioned this pull request Mar 10, 2023

SIGSEGV at startup when a rewrite_tag filter has no Match #6991

Closed

Rishi-Tea mentioned this pull request Mar 13, 2023

SIGSEGV on 1.9.4 with stack trace #5753

Closed

amolbms mentioned this pull request May 5, 2023

could not enqueue records into the ring buffer #7071

Closed

PettitWesley mentioned this pull request May 22, 2023

filter: aws metadata group retries #7245

Merged

4 tasks

RaniVedprakash mentioned this pull request Jul 25, 2023

Fluentbit pods are crashing/restarting after SIGSEV error #7751

Closed

WTThomas1 mentioned this pull request Nov 3, 2023

Grep Filter Plugin Exclude Not Matching Issue #8098

Closed

mkatana-silkycoders mentioned this pull request Nov 6, 2023

High CPU / Memory usage using kubernetes_events plugin #8138

Closed

mrunmayee003 mentioned this pull request Nov 28, 2023

SIGSEGV for forward input plugin #8225

Closed

srini38 mentioned this pull request Dec 2, 2023

lib: ctraces: Fix a crash in fluent-bit when in_opentelemetry plugin handles a trace message from opentelemetry-cpp/example_otlp_http sample app #8241

Closed

4 tasks

hilshalom mentioned this pull request Dec 5, 2023

Getting SIGSEGV when host is restarted #8252

Closed

zecke mentioned this pull request May 25, 2024

core: Fix crash when running dry #8872

Merged

1 task

suryamanikar mentioned this pull request Jul 23, 2024

flb-pipeline worker CPU stays high even when there is no input or output events. #9124

Closed

anderssynstad mentioned this pull request Oct 25, 2024

Setting theaded to true in prometheus_scrape input causes SIGSEGV #9525

Open

AkshayDubey29 mentioned this pull request Nov 15, 2024

With threaded on, SIGSEGV occurs during a dry run #9355

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

IPv6 support #3

IPv6 support #3

pandax381 commented May 27, 2015

edsiper commented May 27, 2015

IPv6 support #3

IPv6 support #3

Conversation

pandax381 commented May 27, 2015

edsiper commented May 27, 2015