From patchwork Mon Mar 13 16:25:12 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Marcelo Tosatti X-Patchwork-Id: 68922 Return-Path: Delivered-To: ouuuleilei@gmail.com Received: by 2002:a5d:5915:0:0:0:0:0 with SMTP id v21csp1289709wrd; Mon, 13 Mar 2023 09:46:15 -0700 (PDT) X-Google-Smtp-Source: AK7set9JZjUrFVxJDlfyvuUdZXJYPl7h9/iO4BBkbPkJOAclco4/2THZTTzf0QjbyD8ANX8AK6ju X-Received: by 2002:a05:6a20:728a:b0:ce:c188:68af with SMTP id o10-20020a056a20728a00b000cec18868afmr34204564pzk.17.1678725975003; Mon, 13 Mar 2023 09:46:15 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1678725974; cv=none; d=google.com; s=arc-20160816; b=soBsl5AMu4jcB0dCbY3Iy5HcDeNQdyimMVZZvC8yLBQCi1vI4/wSe0Q9/mi0tRXO+9 dmd93YiFBnUQnO28bqjPdk3JLnQ6wdK/x/O3OTCNpRAy5PE3aW5Tsy1uMOLAeoBysrB6 b070kVTnwweGqegitE0DK4cs0hP8WVh7PZ809JzeqWoME/bd6oUQI4DME6ryn1NzXWzw opJF+dpgSfW/dCBWgXW4g3pz6OvxwzNz5Voz/AJDty6Ip8KjcWB8CCFmkkqCYraA1qe+ 9+fdF9+GhLme/E9a+kz8DfQxFaPU6aeZpWf926IO55S+LocvS2+0Va8akS1qhVTlsGjO xomw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:mime-version:references:subject:cc:to:from:date :user-agent:message-id:dkim-signature; bh=X5A6sr5GdS/CRp9e0AjLg+A82o3GBDzuPA8yAWqGcJk=; b=Rzfe1HZPsJ/FEnyni+r/ZtyLLx9Fw9DAKYafbHu8umG2lcwPyM17JXepk192eCTv4G Bq/l82GW88TL93cdLjxiFZGKgCnHgTjPZJxazzlxY9N+yACWy9XdWDzEvTi+wbdio9C8 4b024bghJOy/l/k66sAMxV8p/J8DmN7i94jsMHuGlQ6dIhW7w7xzKlvLSsP2nNVL8f9Y Valk09yXAZ0OOzRQS+UVTRavAyiZCWHnELg4YwsCQqaEssyuM3/0xmSg9LkC9tAeyOz5 2KcZP8MwlbPbe+MkqtTru5/RVYytFpbTuR5qco2y+tB6DeYFUcusgKQGOMpvlS4J29Ue k45A== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=HSudOZjE; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id k189-20020a6384c6000000b004e0d688fb83si5247236pgd.824.2023.03.13.09.46.02; Mon, 13 Mar 2023 09:46:14 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@redhat.com header.s=mimecast20190719 header.b=HSudOZjE; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S231232AbjCMQ31 (ORCPT + 99 others); Mon, 13 Mar 2023 12:29:27 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:50276 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S231247AbjCMQ3C (ORCPT ); Mon, 13 Mar 2023 12:29:02 -0400 Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.133.124]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id BEDE479B2E for ; Mon, 13 Mar 2023 09:27:45 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1678724864; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: references:references; bh=X5A6sr5GdS/CRp9e0AjLg+A82o3GBDzuPA8yAWqGcJk=; b=HSudOZjEEfr2uPyzpQtiF5iKvVWvQ3jVBUVZAm1l/SSxfHzP/azl0sUuOWkgbHk72ybQ7e 06CvvPcUoOi1Y/4NAK8mHdN3ITiKG0joc2JkM4/0jKMIpVJdRce7k9tC80U2tCtfVznKaZ D5ywHeINLerDDVNow2we8nlRYMYKtRA= Received: from mimecast-mx02.redhat.com (mx3-rdu2.redhat.com [66.187.233.73]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id us-mta-336-mFgJK7bbMs6HbOsxZVqtVA-1; Mon, 13 Mar 2023 12:27:42 -0400 X-MC-Unique: mFgJK7bbMs6HbOsxZVqtVA-1 Received: from smtp.corp.redhat.com (int-mx02.intmail.prod.int.rdu2.redhat.com [10.11.54.2]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mimecast-mx02.redhat.com (Postfix) with ESMTPS id DA28F3814947; Mon, 13 Mar 2023 16:27:41 +0000 (UTC) Received: from tpad.localdomain (ovpn-112-2.gru2.redhat.com [10.97.112.2]) by smtp.corp.redhat.com (Postfix) with ESMTPS id AB14C40C6E68; Mon, 13 Mar 2023 16:27:41 +0000 (UTC) Received: by tpad.localdomain (Postfix, from userid 1000) id 1EF8E4038A1E6; Mon, 13 Mar 2023 13:26:44 -0300 (-03) Message-ID: <20230313162634.383217649@redhat.com> User-Agent: quilt/0.67 Date: Mon, 13 Mar 2023 13:25:12 -0300 From: Marcelo Tosatti To: Christoph Lameter Cc: Aaron Tomlin , Frederic Weisbecker , Andrew Morton , linux-kernel@vger.kernel.org, linux-mm@kvack.org, Russell King , Huacai Chen , Heiko Carstens , x86@kernel.org, Vlastimil Babka , Marcelo Tosatti Subject: [PATCH v5 05/12] add this_cpu_cmpxchg_local and asm-generic definitions References: <20230313162507.032200398@redhat.com> MIME-Version: 1.0 X-Scanned-By: MIMEDefang 3.1 on 10.11.54.2 X-Spam-Status: No, score=-2.1 required=5.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_NONE, RCVD_IN_MSPIKE_H2,SPF_HELO_NONE,SPF_NONE autolearn=ham autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org X-getmail-retrieved-from-mailbox: =?utf-8?q?INBOX?= X-GMAIL-THRID: =?utf-8?q?1760271767947974546?= X-GMAIL-MSGID: =?utf-8?q?1760271767947974546?= Goal is to have vmstat_shepherd to transfer from per-CPU counters to global counters remotely. For this, an atomic this_cpu_cmpxchg is necessary. Add this_cpu_cmpxchg_local_ helpers to asm-generic/percpu.h. Signed-off-by: Marcelo Tosatti Index: linux-vmstat-remote/include/asm-generic/percpu.h =================================================================== --- linux-vmstat-remote.orig/include/asm-generic/percpu.h +++ linux-vmstat-remote/include/asm-generic/percpu.h @@ -424,6 +424,23 @@ do { \ this_cpu_generic_cmpxchg(pcp, oval, nval) #endif +#ifndef this_cpu_cmpxchg_local_1 +#define this_cpu_cmpxchg_local_1(pcp, oval, nval) \ + this_cpu_generic_cmpxchg(pcp, oval, nval) +#endif +#ifndef this_cpu_cmpxchg_local_2 +#define this_cpu_cmpxchg_local_2(pcp, oval, nval) \ + this_cpu_generic_cmpxchg(pcp, oval, nval) +#endif +#ifndef this_cpu_cmpxchg_local_4 +#define this_cpu_cmpxchg_local_4(pcp, oval, nval) \ + this_cpu_generic_cmpxchg(pcp, oval, nval) +#endif +#ifndef this_cpu_cmpxchg_local_8 +#define this_cpu_cmpxchg_local_8(pcp, oval, nval) \ + this_cpu_generic_cmpxchg(pcp, oval, nval) +#endif + #ifndef this_cpu_cmpxchg_double_1 #define this_cpu_cmpxchg_double_1(pcp1, pcp2, oval1, oval2, nval1, nval2) \ this_cpu_generic_cmpxchg_double(pcp1, pcp2, oval1, oval2, nval1, nval2) Index: linux-vmstat-remote/include/linux/percpu-defs.h =================================================================== --- linux-vmstat-remote.orig/include/linux/percpu-defs.h +++ linux-vmstat-remote/include/linux/percpu-defs.h @@ -513,6 +513,8 @@ do { \ #define this_cpu_xchg(pcp, nval) __pcpu_size_call_return2(this_cpu_xchg_, pcp, nval) #define this_cpu_cmpxchg(pcp, oval, nval) \ __pcpu_size_call_return2(this_cpu_cmpxchg_, pcp, oval, nval) +#define this_cpu_cmpxchg_local(pcp, oval, nval) \ + __pcpu_size_call_return2(this_cpu_cmpxchg_local_, pcp, oval, nval) #define this_cpu_cmpxchg_double(pcp1, pcp2, oval1, oval2, nval1, nval2) \ __pcpu_double_call_return_bool(this_cpu_cmpxchg_double_, pcp1, pcp2, oval1, oval2, nval1, nval2)