Message ID | 20230517025424.601141-1-pizhenwei@bytedance.com |
---|---|
Headers |
Return-Path: <linux-kernel-owner@vger.kernel.org> Delivered-To: ouuuleilei@gmail.com Received: by 2002:a59:b0ea:0:b0:3b6:4342:cba0 with SMTP id b10csp858174vqo; Tue, 16 May 2023 20:54:02 -0700 (PDT) X-Google-Smtp-Source: ACHHUZ7wDHRMSbDmXNHUDCQYuR/W9hgqhMBIRs0714Ccq5phZTMTLZ8l0p2PZc+Xuw4vSaVh/ovS X-Received: by 2002:a05:6a00:14ce:b0:640:f313:efba with SMTP id w14-20020a056a0014ce00b00640f313efbamr54160283pfu.19.1684295642620; Tue, 16 May 2023 20:54:02 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1684295642; cv=none; d=google.com; s=arc-20160816; b=GITj21ClYZeeHgpbkQam3/CxxIVew0eBr22SWkZQOhluUnnVNKZy81ZQyw+pnWFOFO LPVrNeN3UmyRyHmJzh7jEQOLg+676idytpD2ZH9B0kwHXHjyO+pEp5YO3UtqVdILJZKo 44r6HueOx1h2pQrAzOWs9RIwi4AoD/DSdgSKrlDeUJHY2yYn9LlZEFWyReU1LlKggYnP bCJyISUuK0XydEuWLGxUKOh0NDhOZtYfqBkvtRGxgGQjsFL6cVccREYOft5HSjLEhBoJ IXsC7FTn21CiF7nNUTN5SHCqGuo7nN7sreRBropu3RtMnKrp3tIkZGCWYtswZMwfeTHM gIuw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :message-id:date:subject:cc:to:from:dkim-signature; bh=0ZO1TY70d7JB54ZSdTzcbWlEKFT+XnqOX871W+Km0K4=; b=0wneuNDN3JfLtnuVKEZv+GB3qLNUVT9jvUrPidOYwb5+STPV2amlAuLKBP6/3q6U0r rL2BTa2Hml9cU4EAvC4ONoMhqIJApjKE30gUAeTkj5AcW+3Zc9Ahg/WwZCobn2LDz/ou YOo9EOpN5Birnodz6w9Z0GlgIoQ3p7uA+euFbcmPHI+AbhbVmOK/BzXc2Ej9xU8VM/XS iUNwFymFzA4WaUtwfZYP0zykjm0zuTjvDYbngpFl2SXzeB2nfQ7eDhuI/HfsnoM5MFp6 cuI8dDGiPdy6dyfcX+yYyuSgz/3IPO29DAgkAW+c/BYQoiPTZ16aCmfaOh/DZ/qd2mjX HEmw== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@bytedance.com header.s=google header.b="M/J5k6mp"; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=QUARANTINE sp=QUARANTINE dis=NONE) header.from=bytedance.com Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id c2-20020a621c02000000b005a8b856ad47si20410469pfc.7.2023.05.16.20.53.48; Tue, 16 May 2023 20:54:02 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@bytedance.com header.s=google header.b="M/J5k6mp"; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=QUARANTINE sp=QUARANTINE dis=NONE) header.from=bytedance.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S232253AbjEQC47 (ORCPT <rfc822;abdi.embedded@gmail.com> + 99 others); Tue, 16 May 2023 22:56:59 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:39146 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S231207AbjEQC44 (ORCPT <rfc822;linux-kernel@vger.kernel.org>); Tue, 16 May 2023 22:56:56 -0400 Received: from mail-pf1-x430.google.com (mail-pf1-x430.google.com [IPv6:2607:f8b0:4864:20::430]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id C062E448C for <linux-kernel@vger.kernel.org>; Tue, 16 May 2023 19:56:32 -0700 (PDT) Received: by mail-pf1-x430.google.com with SMTP id d2e1a72fcca58-6434e65d808so193738b3a.3 for <linux-kernel@vger.kernel.org>; Tue, 16 May 2023 19:56:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bytedance.com; s=google; t=1684292192; x=1686884192; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:from:to:cc:subject:date:message-id:reply-to; bh=0ZO1TY70d7JB54ZSdTzcbWlEKFT+XnqOX871W+Km0K4=; b=M/J5k6mpUDJ7zHnVuje5rzGIiUI4Fg5+wLDHTXT1id7bm7QXJTEs+JIbbz0KNOPlHP 5RHGgG2nCX/wB65HSNpsJsx7WlN+Q1iopT7D9j9GVBSOxHR2qxhShnJKb3IzZmtb+9ue Z8gVkhum+qzraD7SObBaFfdehgltTpwR87/Qjg6tEAM9c2jSGZdLpUTMSI3+La3sxZop yXkTqN89pzj+QFfTVclKC6MGgbbL9XsdFCCSHKvVNhjRD3qfU3Umsvj7zxr4lvDJat03 DF7g2yBjgODafx8wj0zX71ThL+T444fKM4hCeK155iq38q6D54vPTABWJHGROlQhEXJT G10g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1684292192; x=1686884192; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=0ZO1TY70d7JB54ZSdTzcbWlEKFT+XnqOX871W+Km0K4=; b=jFdyAxW3X/8Dfr4PbTAHkKTsxsX228jJeLs4NHauZR9tnEqqrtVqdWw/YY+higmzgY KnOQAHXF/ykliOctJxanQrQ2fOk9oxTtBn2tBa3JC4DywFtTJoGg5HsIVcO0/a62sR1a yQ0N4Owx+2RpJ9deK3+gg2ktHTnlFWdus2L/FH6I6IjYpGobJFmSCVHXaOEU+ZQzK9Ve agDx2jygtaN64qf1/QHKHRhxv2HwQbHOnKI2g5R4YQqvDbofwb6YeVNKciH+KsDBwvI4 14j0Bs6IxHcZCobad3tjkRQ0pgDcFZCZ2I++1gGOFBypfniDPOVDODb8dYHPGxD4lcsm Lu7A== X-Gm-Message-State: AC+VfDymI0qa4RsaV6sGhHAixQfX2hZL4QikQF4NRf9GTiA3DeBnEzHt Ph6qBKHhe05yrsZ1s03mNOZhdw== X-Received: by 2002:aa7:88ce:0:b0:645:cfb0:2779 with SMTP id k14-20020aa788ce000000b00645cfb02779mr35734717pff.26.1684292192266; Tue, 16 May 2023 19:56:32 -0700 (PDT) Received: from always-x1.bytedance.net ([61.213.176.11]) by smtp.gmail.com with ESMTPSA id b19-20020aa78713000000b00643355ff6a6sm14527971pfo.99.2023.05.16.19.56.29 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 16 May 2023 19:56:31 -0700 (PDT) From: zhenwei pi <pizhenwei@bytedance.com> To: stefanha@redhat.com, mst@redhat.com, jasowang@redhat.com Cc: xuanzhuo@linux.alibaba.com, virtualization@lists.linux-foundation.org, linux-kernel@vger.kernel.org, zhenwei pi <pizhenwei@bytedance.com> Subject: [PATCH v2 0/2] virtio: abstract virtqueue related methods Date: Wed, 17 May 2023 10:54:22 +0800 Message-Id: <20230517025424.601141-1-pizhenwei@bytedance.com> X-Mailer: git-send-email 2.25.1 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=-2.1 required=5.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_NONE, SPF_HELO_NONE,SPF_PASS,T_SCC_BODY_TEXT_LINE,URIBL_BLOCKED autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: <linux-kernel.vger.kernel.org> X-Mailing-List: linux-kernel@vger.kernel.org X-getmail-retrieved-from-mailbox: =?utf-8?q?INBOX?= X-GMAIL-THRID: =?utf-8?q?1766109718947202981?= X-GMAIL-MSGID: =?utf-8?q?1766111987534429566?= |
Series |
virtio: abstract virtqueue related methods
|
|
Message
zhenwei pi
May 17, 2023, 2:54 a.m. UTC
v1 -> v2: - Suggested by MST, use fast path for vring based performance sensitive API. - Reduce changes in tools/virtio. Add test result(no obvious change): Before: time ./vringh_test --parallel Using CPUS 0 and 191 Guest: notified 10036893, pinged 68278 Host: notified 68278, pinged 3093532 real 0m14.463s user 0m6.437s sys 0m8.010s After: time ./vringh_test --parallel Using CPUS 0 and 191 Guest: notified 10036709, pinged 68347 Host: notified 68347, pinged 3085292 real 0m14.196s user 0m6.289s sys 0m7.885s v1: Hi, 3 weeks ago, I posted a proposal 'Virtio Over Fabrics': https://lists.oasis-open.org/archives/virtio-comment/202304/msg00442.html Jason and Stefan pointed out that a non-vring based virtqueue has a chance to overwrite virtqueue instead of using vring virtqueue. Then I try to abstract virtqueue related methods in this series, the details changes see the comment of patch 'virtio: abstract virtqueue related methods'. Something is still remained: - __virtqueue_break/__virtqueue_unbreak is supposed to use by internal virtio core, I'd like to rename them to vring_virtqueue_break /vring_virtqueue_unbreak. Is this reasonable? - virtqueue_get_desc_addr/virtqueue_get_avail_addr/virtqueue_get_used_addr /virtqueue_get_vring is vring specific, I'd like to rename them like vring_virtqueue_get_desc_addr. Is this reasonable? - there are still some functions in virtio_ring.c with prefix *virtqueue*, for example 'virtqueue_add_split', just keep it or rename it to 'vring_virtqueue_add_split'? zhenwei pi (2): virtio: abstract virtqueue related methods tools/virtio: implement virtqueue in test drivers/virtio/virtio_ring.c | 285 +++++----------------- include/linux/virtio.h | 441 +++++++++++++++++++++++++++++++---- include/linux/virtio_ring.h | 26 +++ tools/virtio/linux/virtio.h | 355 +++++++++++++++++++++++++--- 4 files changed, 807 insertions(+), 300 deletions(-)
Comments
On Wed, May 17, 2023 at 10:54:22AM +0800, zhenwei pi wrote: > v1 -> v2: > - Suggested by MST, use fast path for vring based performance > sensitive API. > - Reduce changes in tools/virtio. > > Add test result(no obvious change): > Before: > time ./vringh_test --parallel > Using CPUS 0 and 191 > Guest: notified 10036893, pinged 68278 > Host: notified 68278, pinged 3093532 > > real 0m14.463s > user 0m6.437s > sys 0m8.010s > > After: > time ./vringh_test --parallel > Using CPUS 0 and 191 > Guest: notified 10036709, pinged 68347 > Host: notified 68347, pinged 3085292 > > real 0m14.196s > user 0m6.289s > sys 0m7.885s > > v1: > Hi, > > 3 weeks ago, I posted a proposal 'Virtio Over Fabrics': > https://lists.oasis-open.org/archives/virtio-comment/202304/msg00442.html > > Jason and Stefan pointed out that a non-vring based virtqueue has a > chance to overwrite virtqueue instead of using vring virtqueue. > > Then I try to abstract virtqueue related methods in this series, the > details changes see the comment of patch 'virtio: abstract virtqueue related methods'. > > Something is still remained: > - __virtqueue_break/__virtqueue_unbreak is supposed to use by internal > virtio core, I'd like to rename them to vring_virtqueue_break > /vring_virtqueue_unbreak. Is this reasonable? Why? These just set a flag? > - virtqueue_get_desc_addr/virtqueue_get_avail_addr/virtqueue_get_used_addr > /virtqueue_get_vring is vring specific, I'd like to rename them like > vring_virtqueue_get_desc_addr. Is this reasonable? > - there are still some functions in virtio_ring.c with prefix *virtqueue*, > for example 'virtqueue_add_split', just keep it or rename it to > 'vring_virtqueue_add_split'? > zhenwei pi (2): > virtio: abstract virtqueue related methods > tools/virtio: implement virtqueue in test > > drivers/virtio/virtio_ring.c | 285 +++++----------------- > include/linux/virtio.h | 441 +++++++++++++++++++++++++++++++---- > include/linux/virtio_ring.h | 26 +++ > tools/virtio/linux/virtio.h | 355 +++++++++++++++++++++++++--- > 4 files changed, 807 insertions(+), 300 deletions(-) > > -- > 2.20.1
On 5/17/23 11:46, Michael S. Tsirkin wrote: > On Wed, May 17, 2023 at 10:54:22AM +0800, zhenwei pi wrote: >> v1 -> v2: >> - Suggested by MST, use fast path for vring based performance >> sensitive API. >> - Reduce changes in tools/virtio. >> >> Add test result(no obvious change): >> Before: >> time ./vringh_test --parallel >> Using CPUS 0 and 191 >> Guest: notified 10036893, pinged 68278 >> Host: notified 68278, pinged 3093532 >> >> real 0m14.463s >> user 0m6.437s >> sys 0m8.010s >> >> After: >> time ./vringh_test --parallel >> Using CPUS 0 and 191 >> Guest: notified 10036709, pinged 68347 >> Host: notified 68347, pinged 3085292 >> >> real 0m14.196s >> user 0m6.289s >> sys 0m7.885s >> >> v1: >> Hi, >> >> 3 weeks ago, I posted a proposal 'Virtio Over Fabrics': >> https://lists.oasis-open.org/archives/virtio-comment/202304/msg00442.html >> >> Jason and Stefan pointed out that a non-vring based virtqueue has a >> chance to overwrite virtqueue instead of using vring virtqueue. >> >> Then I try to abstract virtqueue related methods in this series, the >> details changes see the comment of patch 'virtio: abstract virtqueue related methods'. >> >> Something is still remained: >> - __virtqueue_break/__virtqueue_unbreak is supposed to use by internal >> virtio core, I'd like to rename them to vring_virtqueue_break >> /vring_virtqueue_unbreak. Is this reasonable? > > Why? These just set a flag? > Rename '__virtqueue_break' to 'vring_virtqueue_break', to make symbols exported from virtio_ring.ko have unified prefix 'vring_virtqueue_xxx'. >> - virtqueue_get_desc_addr/virtqueue_get_avail_addr/virtqueue_get_used_addr >> /virtqueue_get_vring is vring specific, I'd like to rename them like >> vring_virtqueue_get_desc_addr. Is this reasonable? >> - there are still some functions in virtio_ring.c with prefix *virtqueue*, >> for example 'virtqueue_add_split', just keep it or rename it to >> 'vring_virtqueue_add_split'? >> zhenwei pi (2): >> virtio: abstract virtqueue related methods >> tools/virtio: implement virtqueue in test >> >> drivers/virtio/virtio_ring.c | 285 +++++----------------- >> include/linux/virtio.h | 441 +++++++++++++++++++++++++++++++---- >> include/linux/virtio_ring.h | 26 +++ >> tools/virtio/linux/virtio.h | 355 +++++++++++++++++++++++++--- >> 4 files changed, 807 insertions(+), 300 deletions(-) >> >> -- >> 2.20.1 >
On Wed, May 17, 2023 at 11:51:03AM +0800, zhenwei pi wrote: > > > On 5/17/23 11:46, Michael S. Tsirkin wrote: > > On Wed, May 17, 2023 at 10:54:22AM +0800, zhenwei pi wrote: > > > v1 -> v2: > > > - Suggested by MST, use fast path for vring based performance > > > sensitive API. > > > - Reduce changes in tools/virtio. > > > > > > Add test result(no obvious change): > > > Before: > > > time ./vringh_test --parallel > > > Using CPUS 0 and 191 > > > Guest: notified 10036893, pinged 68278 > > > Host: notified 68278, pinged 3093532 > > > > > > real 0m14.463s > > > user 0m6.437s > > > sys 0m8.010s > > > > > > After: > > > time ./vringh_test --parallel > > > Using CPUS 0 and 191 > > > Guest: notified 10036709, pinged 68347 > > > Host: notified 68347, pinged 3085292 > > > > > > real 0m14.196s > > > user 0m6.289s > > > sys 0m7.885s > > > > > > v1: > > > Hi, > > > > > > 3 weeks ago, I posted a proposal 'Virtio Over Fabrics': > > > https://lists.oasis-open.org/archives/virtio-comment/202304/msg00442.html > > > > > > Jason and Stefan pointed out that a non-vring based virtqueue has a > > > chance to overwrite virtqueue instead of using vring virtqueue. > > > > > > Then I try to abstract virtqueue related methods in this series, the > > > details changes see the comment of patch 'virtio: abstract virtqueue related methods'. > > > > > > Something is still remained: > > > - __virtqueue_break/__virtqueue_unbreak is supposed to use by internal > > > virtio core, I'd like to rename them to vring_virtqueue_break > > > /vring_virtqueue_unbreak. Is this reasonable? > > > > Why? These just set a flag? > > > > Rename '__virtqueue_break' to 'vring_virtqueue_break', to make symbols > exported from virtio_ring.ko have unified prefix 'vring_virtqueue_xxx'. I just do not see why you need these callbacks at all. > > > - virtqueue_get_desc_addr/virtqueue_get_avail_addr/virtqueue_get_used_addr > > > /virtqueue_get_vring is vring specific, I'd like to rename them like > > > vring_virtqueue_get_desc_addr. Is this reasonable? > > > - there are still some functions in virtio_ring.c with prefix *virtqueue*, > > > for example 'virtqueue_add_split', just keep it or rename it to > > > 'vring_virtqueue_add_split'? > > > zhenwei pi (2): > > > virtio: abstract virtqueue related methods > > > tools/virtio: implement virtqueue in test > > > > > > drivers/virtio/virtio_ring.c | 285 +++++----------------- > > > include/linux/virtio.h | 441 +++++++++++++++++++++++++++++++---- > > > include/linux/virtio_ring.h | 26 +++ > > > tools/virtio/linux/virtio.h | 355 +++++++++++++++++++++++++--- > > > 4 files changed, 807 insertions(+), 300 deletions(-) > > > > > > -- > > > 2.20.1 > > > > -- > zhenwei pi
On 5/17/23 11:57, Michael S. Tsirkin wrote: > On Wed, May 17, 2023 at 11:51:03AM +0800, zhenwei pi wrote: >> >> >> On 5/17/23 11:46, Michael S. Tsirkin wrote: >>> On Wed, May 17, 2023 at 10:54:22AM +0800, zhenwei pi wrote: >>>> v1 -> v2: >>>> - Suggested by MST, use fast path for vring based performance >>>> sensitive API. >>>> - Reduce changes in tools/virtio. >>>> >>>> Add test result(no obvious change): >>>> Before: >>>> time ./vringh_test --parallel >>>> Using CPUS 0 and 191 >>>> Guest: notified 10036893, pinged 68278 >>>> Host: notified 68278, pinged 3093532 >>>> >>>> real 0m14.463s >>>> user 0m6.437s >>>> sys 0m8.010s >>>> >>>> After: >>>> time ./vringh_test --parallel >>>> Using CPUS 0 and 191 >>>> Guest: notified 10036709, pinged 68347 >>>> Host: notified 68347, pinged 3085292 >>>> >>>> real 0m14.196s >>>> user 0m6.289s >>>> sys 0m7.885s >>>> >>>> v1: >>>> Hi, >>>> >>>> 3 weeks ago, I posted a proposal 'Virtio Over Fabrics': >>>> https://lists.oasis-open.org/archives/virtio-comment/202304/msg00442.html >>>> >>>> Jason and Stefan pointed out that a non-vring based virtqueue has a >>>> chance to overwrite virtqueue instead of using vring virtqueue. >>>> >>>> Then I try to abstract virtqueue related methods in this series, the >>>> details changes see the comment of patch 'virtio: abstract virtqueue related methods'. >>>> >>>> Something is still remained: >>>> - __virtqueue_break/__virtqueue_unbreak is supposed to use by internal >>>> virtio core, I'd like to rename them to vring_virtqueue_break >>>> /vring_virtqueue_unbreak. Is this reasonable? >>> >>> Why? These just set a flag? >>> >> >> Rename '__virtqueue_break' to 'vring_virtqueue_break', to make symbols >> exported from virtio_ring.ko have unified prefix 'vring_virtqueue_xxx'. > > I just do not see why you need these callbacks at all. > I use these callbacks for break/unbreak device like: static inline void virtio_break_device(struct virtio_device *dev) { struct virtqueue *vq; spin_lock(&dev->vqs_list_lock); list_for_each_entry(vq, &dev->vqs, list) { vq->__break(vq); } spin_unlock(&dev->vqs_list_lock); } >>>> - virtqueue_get_desc_addr/virtqueue_get_avail_addr/virtqueue_get_used_addr >>>> /virtqueue_get_vring is vring specific, I'd like to rename them like >>>> vring_virtqueue_get_desc_addr. Is this reasonable? >>>> - there are still some functions in virtio_ring.c with prefix *virtqueue*, >>>> for example 'virtqueue_add_split', just keep it or rename it to >>>> 'vring_virtqueue_add_split'? >>>> zhenwei pi (2): >>>> virtio: abstract virtqueue related methods >>>> tools/virtio: implement virtqueue in test >>>> >>>> drivers/virtio/virtio_ring.c | 285 +++++----------------- >>>> include/linux/virtio.h | 441 +++++++++++++++++++++++++++++++---- >>>> include/linux/virtio_ring.h | 26 +++ >>>> tools/virtio/linux/virtio.h | 355 +++++++++++++++++++++++++--- >>>> 4 files changed, 807 insertions(+), 300 deletions(-) >>>> >>>> -- >>>> 2.20.1 >>> >> >> -- >> zhenwei pi >
On Wed, May 17, 2023 at 12:58:10PM +0800, zhenwei pi wrote: > On 5/17/23 11:57, Michael S. Tsirkin wrote: > > On Wed, May 17, 2023 at 11:51:03AM +0800, zhenwei pi wrote: > > > > > > > > > On 5/17/23 11:46, Michael S. Tsirkin wrote: > > > > On Wed, May 17, 2023 at 10:54:22AM +0800, zhenwei pi wrote: > > > > > v1 -> v2: > > > > > - Suggested by MST, use fast path for vring based performance > > > > > sensitive API. > > > > > - Reduce changes in tools/virtio. > > > > > > > > > > Add test result(no obvious change): > > > > > Before: > > > > > time ./vringh_test --parallel > > > > > Using CPUS 0 and 191 > > > > > Guest: notified 10036893, pinged 68278 > > > > > Host: notified 68278, pinged 3093532 > > > > > > > > > > real 0m14.463s > > > > > user 0m6.437s > > > > > sys 0m8.010s > > > > > > > > > > After: > > > > > time ./vringh_test --parallel > > > > > Using CPUS 0 and 191 > > > > > Guest: notified 10036709, pinged 68347 > > > > > Host: notified 68347, pinged 3085292 > > > > > > > > > > real 0m14.196s > > > > > user 0m6.289s > > > > > sys 0m7.885s > > > > > > > > > > v1: > > > > > Hi, > > > > > > > > > > 3 weeks ago, I posted a proposal 'Virtio Over Fabrics': > > > > > https://lists.oasis-open.org/archives/virtio-comment/202304/msg00442.html > > > > > > > > > > Jason and Stefan pointed out that a non-vring based virtqueue has a > > > > > chance to overwrite virtqueue instead of using vring virtqueue. > > > > > > > > > > Then I try to abstract virtqueue related methods in this series, the > > > > > details changes see the comment of patch 'virtio: abstract virtqueue related methods'. > > > > > > > > > > Something is still remained: > > > > > - __virtqueue_break/__virtqueue_unbreak is supposed to use by internal > > > > > virtio core, I'd like to rename them to vring_virtqueue_break > > > > > /vring_virtqueue_unbreak. Is this reasonable? > > > > > > > > Why? These just set a flag? > > > > > > > > > > Rename '__virtqueue_break' to 'vring_virtqueue_break', to make symbols > > > exported from virtio_ring.ko have unified prefix 'vring_virtqueue_xxx'. > > > > I just do not see why you need these callbacks at all. > > > > I use these callbacks for break/unbreak device like: > static inline void virtio_break_device(struct virtio_device *dev) > { > struct virtqueue *vq; > > spin_lock(&dev->vqs_list_lock); > list_for_each_entry(vq, &dev->vqs, list) { > vq->__break(vq); > } > spin_unlock(&dev->vqs_list_lock); > } why do this? backend knows they are broken. > > > > > - virtqueue_get_desc_addr/virtqueue_get_avail_addr/virtqueue_get_used_addr > > > > > /virtqueue_get_vring is vring specific, I'd like to rename them like > > > > > vring_virtqueue_get_desc_addr. Is this reasonable? > > > > > - there are still some functions in virtio_ring.c with prefix *virtqueue*, > > > > > for example 'virtqueue_add_split', just keep it or rename it to > > > > > 'vring_virtqueue_add_split'? > > > > > zhenwei pi (2): > > > > > virtio: abstract virtqueue related methods > > > > > tools/virtio: implement virtqueue in test > > > > > > > > > > drivers/virtio/virtio_ring.c | 285 +++++----------------- > > > > > include/linux/virtio.h | 441 +++++++++++++++++++++++++++++++---- > > > > > include/linux/virtio_ring.h | 26 +++ > > > > > tools/virtio/linux/virtio.h | 355 +++++++++++++++++++++++++--- > > > > > 4 files changed, 807 insertions(+), 300 deletions(-) > > > > > > > > > > -- > > > > > 2.20.1 > > > > > > > > > > -- > > > zhenwei pi > > > > -- > zhenwei pi
On 5/17/23 14:10, Michael S. Tsirkin wrote: > On Wed, May 17, 2023 at 12:58:10PM +0800, zhenwei pi wrote: >> On 5/17/23 11:57, Michael S. Tsirkin wrote: >>> On Wed, May 17, 2023 at 11:51:03AM +0800, zhenwei pi wrote: >>>> >>>> >>>> On 5/17/23 11:46, Michael S. Tsirkin wrote: >>>>> On Wed, May 17, 2023 at 10:54:22AM +0800, zhenwei pi wrote: >>>>>> v1 -> v2: >>>>>> - Suggested by MST, use fast path for vring based performance >>>>>> sensitive API. >>>>>> - Reduce changes in tools/virtio. >>>>>> >>>>>> Add test result(no obvious change): >>>>>> Before: >>>>>> time ./vringh_test --parallel >>>>>> Using CPUS 0 and 191 >>>>>> Guest: notified 10036893, pinged 68278 >>>>>> Host: notified 68278, pinged 3093532 >>>>>> >>>>>> real 0m14.463s >>>>>> user 0m6.437s >>>>>> sys 0m8.010s >>>>>> >>>>>> After: >>>>>> time ./vringh_test --parallel >>>>>> Using CPUS 0 and 191 >>>>>> Guest: notified 10036709, pinged 68347 >>>>>> Host: notified 68347, pinged 3085292 >>>>>> >>>>>> real 0m14.196s >>>>>> user 0m6.289s >>>>>> sys 0m7.885s >>>>>> >>>>>> v1: >>>>>> Hi, >>>>>> >>>>>> 3 weeks ago, I posted a proposal 'Virtio Over Fabrics': >>>>>> https://lists.oasis-open.org/archives/virtio-comment/202304/msg00442.html >>>>>> >>>>>> Jason and Stefan pointed out that a non-vring based virtqueue has a >>>>>> chance to overwrite virtqueue instead of using vring virtqueue. >>>>>> >>>>>> Then I try to abstract virtqueue related methods in this series, the >>>>>> details changes see the comment of patch 'virtio: abstract virtqueue related methods'. >>>>>> >>>>>> Something is still remained: >>>>>> - __virtqueue_break/__virtqueue_unbreak is supposed to use by internal >>>>>> virtio core, I'd like to rename them to vring_virtqueue_break >>>>>> /vring_virtqueue_unbreak. Is this reasonable? >>>>> >>>>> Why? These just set a flag? >>>>> >>>> >>>> Rename '__virtqueue_break' to 'vring_virtqueue_break', to make symbols >>>> exported from virtio_ring.ko have unified prefix 'vring_virtqueue_xxx'. >>> >>> I just do not see why you need these callbacks at all. >>> >> >> I use these callbacks for break/unbreak device like: >> static inline void virtio_break_device(struct virtio_device *dev) >> { >> struct virtqueue *vq; >> >> spin_lock(&dev->vqs_list_lock); >> list_for_each_entry(vq, &dev->vqs, list) { >> vq->__break(vq); >> } >> spin_unlock(&dev->vqs_list_lock); >> } > > why do this? backend knows they are broken. > I grep 'virtio_break_device' in the latest code: arch/um/drivers/virtio_uml.c:1147: virtio_break_device(&vu_dev->vdev); arch/um/drivers/virtio_uml.c:1285: virtio_break_device(&vu_dev->vdev); drivers/crypto/virtio/virtio_crypto_core.c:269: virtio_break_device(vcrypto->vdev); drivers/s390/virtio/virtio_ccw.c:1251: virtio_break_device(&vcdev->vdev); drivers/s390/virtio/virtio_ccw.c:1268: virtio_break_device(&vcdev->vdev); drivers/firmware/arm_scmi/virtio.c:489: virtio_break_device(vioch->vqueue->vdev); drivers/char/virtio_console.c:1956: virtio_break_device(vdev); Some virtio drivers use 'virtio_break_device'... >>>>>> - virtqueue_get_desc_addr/virtqueue_get_avail_addr/virtqueue_get_used_addr >>>>>> /virtqueue_get_vring is vring specific, I'd like to rename them like >>>>>> vring_virtqueue_get_desc_addr. Is this reasonable? >>>>>> - there are still some functions in virtio_ring.c with prefix *virtqueue*, >>>>>> for example 'virtqueue_add_split', just keep it or rename it to >>>>>> 'vring_virtqueue_add_split'? >>>>>> zhenwei pi (2): >>>>>> virtio: abstract virtqueue related methods >>>>>> tools/virtio: implement virtqueue in test >>>>>> >>>>>> drivers/virtio/virtio_ring.c | 285 +++++----------------- >>>>>> include/linux/virtio.h | 441 +++++++++++++++++++++++++++++++---- >>>>>> include/linux/virtio_ring.h | 26 +++ >>>>>> tools/virtio/linux/virtio.h | 355 +++++++++++++++++++++++++--- >>>>>> 4 files changed, 807 insertions(+), 300 deletions(-) >>>>>> >>>>>> -- >>>>>> 2.20.1 >>>>> >>>> >>>> -- >>>> zhenwei pi >>> >> >> -- >> zhenwei pi >
On Wed, May 17, 2023 at 02:21:09PM +0800, zhenwei pi wrote: > On 5/17/23 14:10, Michael S. Tsirkin wrote: > > On Wed, May 17, 2023 at 12:58:10PM +0800, zhenwei pi wrote: > > > On 5/17/23 11:57, Michael S. Tsirkin wrote: > > > > On Wed, May 17, 2023 at 11:51:03AM +0800, zhenwei pi wrote: > > > > > > > > > > > > > > > On 5/17/23 11:46, Michael S. Tsirkin wrote: > > > > > > On Wed, May 17, 2023 at 10:54:22AM +0800, zhenwei pi wrote: > > > > > > > v1 -> v2: > > > > > > > - Suggested by MST, use fast path for vring based performance > > > > > > > sensitive API. > > > > > > > - Reduce changes in tools/virtio. > > > > > > > > > > > > > > Add test result(no obvious change): > > > > > > > Before: > > > > > > > time ./vringh_test --parallel > > > > > > > Using CPUS 0 and 191 > > > > > > > Guest: notified 10036893, pinged 68278 > > > > > > > Host: notified 68278, pinged 3093532 > > > > > > > > > > > > > > real 0m14.463s > > > > > > > user 0m6.437s > > > > > > > sys 0m8.010s > > > > > > > > > > > > > > After: > > > > > > > time ./vringh_test --parallel > > > > > > > Using CPUS 0 and 191 > > > > > > > Guest: notified 10036709, pinged 68347 > > > > > > > Host: notified 68347, pinged 3085292 > > > > > > > > > > > > > > real 0m14.196s > > > > > > > user 0m6.289s > > > > > > > sys 0m7.885s > > > > > > > > > > > > > > v1: > > > > > > > Hi, > > > > > > > > > > > > > > 3 weeks ago, I posted a proposal 'Virtio Over Fabrics': > > > > > > > https://lists.oasis-open.org/archives/virtio-comment/202304/msg00442.html > > > > > > > > > > > > > > Jason and Stefan pointed out that a non-vring based virtqueue has a > > > > > > > chance to overwrite virtqueue instead of using vring virtqueue. > > > > > > > > > > > > > > Then I try to abstract virtqueue related methods in this series, the > > > > > > > details changes see the comment of patch 'virtio: abstract virtqueue related methods'. > > > > > > > > > > > > > > Something is still remained: > > > > > > > - __virtqueue_break/__virtqueue_unbreak is supposed to use by internal > > > > > > > virtio core, I'd like to rename them to vring_virtqueue_break > > > > > > > /vring_virtqueue_unbreak. Is this reasonable? > > > > > > > > > > > > Why? These just set a flag? > > > > > > > > > > > > > > > > Rename '__virtqueue_break' to 'vring_virtqueue_break', to make symbols > > > > > exported from virtio_ring.ko have unified prefix 'vring_virtqueue_xxx'. > > > > > > > > I just do not see why you need these callbacks at all. > > > > > > > > > > I use these callbacks for break/unbreak device like: > > > static inline void virtio_break_device(struct virtio_device *dev) > > > { > > > struct virtqueue *vq; > > > > > > spin_lock(&dev->vqs_list_lock); > > > list_for_each_entry(vq, &dev->vqs, list) { > > > vq->__break(vq); > > > } > > > spin_unlock(&dev->vqs_list_lock); > > > } > > > > why do this? backend knows they are broken. > > > > I grep 'virtio_break_device' in the latest code: > arch/um/drivers/virtio_uml.c:1147: virtio_break_device(&vu_dev->vdev); > arch/um/drivers/virtio_uml.c:1285: virtio_break_device(&vu_dev->vdev); > drivers/crypto/virtio/virtio_crypto_core.c:269: > virtio_break_device(vcrypto->vdev); > drivers/s390/virtio/virtio_ccw.c:1251: virtio_break_device(&vcdev->vdev); > drivers/s390/virtio/virtio_ccw.c:1268: virtio_break_device(&vcdev->vdev); > drivers/firmware/arm_scmi/virtio.c:489: > virtio_break_device(vioch->vqueue->vdev); > drivers/char/virtio_console.c:1956: virtio_break_device(vdev); > > Some virtio drivers use 'virtio_break_device'... You should read the code and understand what it does, not just grep things and make assumptions. What virtio_break_device does is stop linux from sending new requests. > > > > > > > - virtqueue_get_desc_addr/virtqueue_get_avail_addr/virtqueue_get_used_addr > > > > > > > /virtqueue_get_vring is vring specific, I'd like to rename them like > > > > > > > vring_virtqueue_get_desc_addr. Is this reasonable? > > > > > > > - there are still some functions in virtio_ring.c with prefix *virtqueue*, > > > > > > > for example 'virtqueue_add_split', just keep it or rename it to > > > > > > > 'vring_virtqueue_add_split'? > > > > > > > zhenwei pi (2): > > > > > > > virtio: abstract virtqueue related methods > > > > > > > tools/virtio: implement virtqueue in test > > > > > > > > > > > > > > drivers/virtio/virtio_ring.c | 285 +++++----------------- > > > > > > > include/linux/virtio.h | 441 +++++++++++++++++++++++++++++++---- > > > > > > > include/linux/virtio_ring.h | 26 +++ > > > > > > > tools/virtio/linux/virtio.h | 355 +++++++++++++++++++++++++--- > > > > > > > 4 files changed, 807 insertions(+), 300 deletions(-) > > > > > > > > > > > > > > -- > > > > > > > 2.20.1 > > > > > > > > > > > > > > > > -- > > > > > zhenwei pi > > > > > > > > > > -- > > > zhenwei pi > > > > -- > zhenwei pi