From patchwork Wed Mar 22 10:22:42 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Vincent Donnefort X-Patchwork-Id: 7024 Return-Path: Delivered-To: ouuuleilei@gmail.com Received: by 2002:a5d:604a:0:0:0:0:0 with SMTP id j10csp2269339wrt; Wed, 22 Mar 2023 03:46:45 -0700 (PDT) X-Google-Smtp-Source: AK7set9QLg0awh5lCoyviXJJufN9c6ESRJBbSutP8Y9QGWpgk3baSMcJCMQGQdSWyLnBQEVRhRZg X-Received: by 2002:aa7:da0a:0:b0:4fb:ec6a:2357 with SMTP id r10-20020aa7da0a000000b004fbec6a2357mr6358045eds.34.1679482005066; Wed, 22 Mar 2023 03:46:45 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1679482005; cv=none; d=google.com; s=arc-20160816; b=nXmtzmehkpgQ9ER9NNhOTDf+SoGSi9FmUJApS6MCueyfph1ZWWNfzXrf9YVhYInFuO iDSIuukI82DVUqs9SniRClmotlPNjcXa+mohDMaECOJ1PyrSz5t0nL+/oHK/fXaPEnV9 vcNPuYZA5LsnrOnG42yDyGHqMZGVbLpm8LxsgLySOlJRhIOx8Jy8+DiZaH1UjhNecbRm ThZtz8+0c32fGnmDYcZYhB2N2k6jRerxSegmm/I9x9kqE+HReSf3kFdgqen8HA6VAVHD IZ18aA+dTZ6sDsnOOWtl10pC/XEwjpcYzUWRCk94CL4n/Pf7ZRZkdZvvd5U9O/MLZdXq qccg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:cc:to:from:subject:message-id:mime-version:date :dkim-signature; bh=MtH1n9QiA63gGMjEpHqesA6wudB34zsYwX818Sy5m4A=; b=H5lsb31f3cLsXX0MJEgIsTIWnzlxKTeBDhmsqO0LOdhAzcsneBocBusoi09kpfaI88 6l5LoR3dxpXPjBVdS8HJFr81GFoyAAu7swl68QDDy37ZNc1H958IesUJb1kWtF+KDCSA GOs2lryqLGTNCCfHPOThcQuyUOcGOIQhYoZJFUDID+lnoOXCmJ2tsY2onaxotFFnCCIf wGJaSAQu6hQjPHbVkMnALCvokiVIR25CezCAoKMyGVAQiK/8iIGFbH8yC5/XOm3o9rFd Whm1dM8C9U2BBl2jGYNp6UPeHz8YKvEZCVkhEOE/OfCe/eU6g7IFHFXoc6wI0hl1v+6H f7bw== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@google.com header.s=20210112 header.b="lGv1/rRD"; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id hb30-20020a170907161e00b0093b5bf364c1si1985397ejc.987.2023.03.22.03.46.21; Wed, 22 Mar 2023 03:46:45 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@google.com header.s=20210112 header.b="lGv1/rRD"; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=google.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S230140AbjCVK07 (ORCPT + 99 others); Wed, 22 Mar 2023 06:26:59 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:34070 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229584AbjCVK06 (ORCPT ); Wed, 22 Mar 2023 06:26:58 -0400 Received: from mail-yw1-x114a.google.com (mail-yw1-x114a.google.com [IPv6:2607:f8b0:4864:20::114a]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id F388B5DED0 for ; Wed, 22 Mar 2023 03:26:48 -0700 (PDT) Received: by mail-yw1-x114a.google.com with SMTP id 00721157ae682-544570e6d82so185937677b3.23 for ; Wed, 22 Mar 2023 03:26:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20210112; t=1679480808; h=cc:to:from:subject:message-id:mime-version:date:from:to:cc:subject :date:message-id:reply-to; bh=MtH1n9QiA63gGMjEpHqesA6wudB34zsYwX818Sy5m4A=; b=lGv1/rRD+5FbA1Y5PSY7SSYcajL+DOt5PFDatW40TMfBdbo9L0x7kjG/PbiS4kuCyQ jASqtZVX6caArqed/337xNw+VyMYGknWzwDT4eR3rlPDHmjmbUT0NlETlHyZ4SN//7nv mC6iasTMkhGk1vDmMzpqsSNWmMy2VTTfXosIcO+/JUPVwcJaHIM27fVwfObXNAZyTfwG 5WrzbHXhWF8TcODAs7DPs38d5phDGrtvmVHaVyAggmGwMQv+vixJMCOgCpKi5mEBsWzU Won6p/mArEqYGbjxf1JEqYE8cDVM99sgqivTDQXX9co4I2pkTU0e1jAu34ic1Ty8Wbid GP7Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; t=1679480808; h=cc:to:from:subject:message-id:mime-version:date:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=MtH1n9QiA63gGMjEpHqesA6wudB34zsYwX818Sy5m4A=; b=0cQtrgvRvs0XFD4w/Uj/8ZIA2uTvVoklap9vlYdx9vjqgjQskfF/Pl6fPaf1yPDKyN 5bUOELq5+86djvca5+CA1Cc/SiYEJugdma2s0nDCO52jj/fBuAtq99QQhzc4uIzsVxPC k18sh7Wpg2MNuCi3DK6k0zap/TcOAwYILvCv8WyELqoG3lWhSRUoK5KfvMAIwzIUCd4o yV6MG5lrDWVY53/1s5ywtPiTMlGNwWtuQPmAGNSHHMs/A0yEjgArqnmyaRcYNkgKyKzE xYExBjJhIBQonXO9xFuP9V8WnjjBYIC5JNqlgPAW/tTe9imK9Dp5VI7JAIB/DRWO0VmI mIaA== X-Gm-Message-State: AAQBX9e+wS3Ix57Xj1B7TUTIeQdb+JNjOC/+Hi4jzZesmYoSuqATdSBH eEtuFI2WatY6YtwV2fSTe5qsZ4eiBj0ZxcVv X-Received: from vdonnefort.c.googlers.com ([fda3:e722:ac3:cc00:28:9cb1:c0a8:2eea]) (user=vdonnefort job=sendgmr) by 2002:a05:6902:1503:b0:af7:38fc:f6da with SMTP id q3-20020a056902150300b00af738fcf6damr1104197ybu.2.1679480808284; Wed, 22 Mar 2023 03:26:48 -0700 (PDT) Date: Wed, 22 Mar 2023 10:22:42 +0000 Mime-Version: 1.0 X-Mailer: git-send-email 2.40.0.rc1.284.g88254d51c5-goog Message-ID: <20230322102244.3239740-1-vdonnefort@google.com> Subject: [PATCH v2 0/2] Introducing trace buffer mapping by user-space From: Vincent Donnefort To: rostedt@goodmis.org, mhiramat@kernel.org, linux-kernel@vger.kernel.org, linux-trace-kernel@vger.kernel.org Cc: kernel-team@android.com, Vincent Donnefort X-Spam-Status: No, score=-7.7 required=5.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_NONE, SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED,USER_IN_DEF_DKIM_WL autolearn=unavailable autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org X-getmail-retrieved-from-mailbox: =?utf-8?q?INBOX?= X-GMAIL-THRID: =?utf-8?q?1761064522898449634?= X-GMAIL-MSGID: =?utf-8?q?1761064522898449634?= The tracing ring-buffers can be stored on disk or sent to network without any copy via splice. However the later doesn't allow real time processing of the traces. A solution is to give access to userspace to the ring-buffer pages directly via a mapping. A piece of software can now become a reader of the ring-buffer, and drive a consuming or non-consuming read in a similar fashion to what trace and trace_pipe offer. Attached to this cover letter an example of consuming read for a ring-buffer, using libtracefs. Vincent v1 -> v2: * Hide data_pages from the userspace struct * Fix META_PAGE_MAX_PAGES * Support for order > 0 meta-page * Add missing page->mapping. Vincent Donnefort (2): ring-buffer: Introducing ring-buffer mapping functions tracing: Allow user-space mapping of the ring-buffer --- #include #include #include #include #include #include #include #include #include #include #include #include #include #define TRACE_MMAP_IOCTL_GET_READER_PAGE _IO('T', 0x1) struct ring_buffer_meta_page_header { __u64 entries; __u64 overrun; __u32 pages_touched; __u32 meta_page_size; __u32 reader_page; /* ID of the current reader page */ __u32 nr_data_pages; /* doesn't take into account the reader_page */ __u32 data_page_head; /* ring-buffer head as an offset from data_start */ __u32 data_start; /* offset within the meta page */ }; /* Need to access private struct to save counters */ struct kbuffer { unsigned long long timestamp; long long lost_events; unsigned long flags; void *subbuffer; void *data; unsigned int index; unsigned int curr; unsigned int next; unsigned int size; unsigned int start; unsigned int first; unsigned int (*read_4)(void *ptr); unsigned long long (*read_8)(void *ptr); unsigned long long (*read_long)(struct kbuffer *kbuf, void *ptr); int (*next_event)(struct kbuffer *kbuf); }; static char *argv0; static bool need_exit; static char *get_this_name(void) { static char *this_name; char *arg; char *p; if (this_name) return this_name; arg = argv0; p = arg+strlen(arg); while (p >= arg && *p != '/') p--; p++; this_name = p; return p; } static void __vdie(const char *fmt, va_list ap, int err) { int ret = errno; char *p = get_this_name(); if (err && errno) perror(p); else ret = -1; fprintf(stderr, " "); vfprintf(stderr, fmt, ap); fprintf(stderr, "\n"); exit(ret); } void pdie(const char *fmt, ...) { va_list ap; va_start(ap, fmt); __vdie(fmt, ap, 1); va_end(ap); } static void read_page(struct tep_handle *tep, struct kbuffer *kbuf, void *data, int page) { static struct trace_seq seq; struct tep_record record; if (seq.buffer) trace_seq_reset(&seq); else trace_seq_init(&seq); while ((record.data = kbuffer_read_event(kbuf, &record.ts))) { kbuffer_next_event(kbuf, NULL); tep_print_event(tep, &seq, &record, "%s-%d %9d\t%s\n", TEP_PRINT_COMM, TEP_PRINT_PID, TEP_PRINT_TIME, TEP_PRINT_NAME); trace_seq_do_printf(&seq); trace_seq_reset(&seq); } } static int next_reader_page(int fd, struct ring_buffer_meta_page_header *meta, struct kbuffer *kbuf) { int prev_reader_page = meta->reader_page; if (ioctl(fd, TRACE_MMAP_IOCTL_GET_READER_PAGE) < 0) pdie("ioctl"); return meta->reader_page; } static void signal_handler(int unused) { printf("Exit!\n"); need_exit = true; } int main(int argc, char **argv) { int page_size, meta_len, data_len, page, fd, start = -1; struct ring_buffer_meta_page_header *map; struct kbuffer *kbuf, prev_kbuf; struct tep_handle *tep; __u64 prev_entries; void *meta, *data; char *buf, path[32]; int cpu; argv0 = argv[0]; cpu = atoi(argv[1]); snprintf(path, 32, "per_cpu/cpu%d/trace_pipe_raw", cpu); signal(SIGINT, signal_handler); tep = tracefs_local_events(NULL); kbuf = tep_kbuffer(tep); page_size = getpagesize(); fd = tracefs_instance_file_open(NULL, path, O_RDONLY); if (fd < 0) pdie("raw"); meta = mmap(NULL, page_size, PROT_READ, MAP_SHARED, fd, 0); if (meta == MAP_FAILED) pdie("mmap"); map = meta; meta_len = map->meta_page_size; if (meta_len > page_size) { munmap(meta, page_size); meta = mmap(NULL, meta_len, PROT_READ, MAP_SHARED, fd, 0); if (meta == MAP_FAILED) pdie("mmap"); map = meta; } printf("entries: %llu\n", map->entries); printf("overrun: %llu\n", map->overrun); printf("pages_touched: %u\n", map->pages_touched); printf("reader_page: %u\n", map->reader_page); printf("nr_data_pages: %u\n\n", map->nr_data_pages); data_len = page_size * (map->nr_data_pages + 1); data = mmap(NULL, data_len, PROT_READ, MAP_SHARED, fd, meta_len); if (data == MAP_FAILED) pdie("mmap data"); page = ((struct ring_buffer_meta_page_header *)meta)->reader_page; again: do { kbuffer_load_subbuffer(kbuf, data + page_size * page); if (page != start) { printf("READER PAGE: %d\n", map->reader_page); } else { kbuf->curr = prev_kbuf.curr; kbuf->index = prev_kbuf.index; kbuf->next = prev_kbuf.next; kbuf->timestamp = prev_kbuf.timestamp; kbuffer_next_event(kbuf, NULL); } prev_entries = map->entries; start = page; read_page(tep, kbuf, data, page); } while ((page = next_reader_page(fd, meta, kbuf)) != start); prev_kbuf.curr = kbuf->curr; prev_kbuf.index = kbuf->index; prev_kbuf.next = kbuf->next; prev_kbuf.timestamp = kbuf->timestamp; while (prev_entries == *(volatile __u64 *)&map->entries && !need_exit) usleep(100000); if (!need_exit) goto again; munmap(data, data_len); munmap(meta, page_size); close(fd); return 0; } include/linux/ring_buffer.h | 8 + include/uapi/linux/trace_mmap.h | 28 +++ kernel/trace/ring_buffer.c | 384 +++++++++++++++++++++++++++++++- kernel/trace/trace.c | 76 ++++++- 4 files changed, 490 insertions(+), 6 deletions(-) create mode 100644 include/uapi/linux/trace_mmap.h