From patchwork Tue Apr 4 21:14:23 2023 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Steve Wahl X-Patchwork-Id: 7724 Return-Path: Delivered-To: ouuuleilei@gmail.com Received: by 2002:a59:b0ea:0:b0:3b6:4342:cba0 with SMTP id b10csp167936vqo; Tue, 4 Apr 2023 14:28:35 -0700 (PDT) X-Google-Smtp-Source: AKy350ZCNFYoNqylg/HupcoIOkCeePnOVBul9fIYJ2kOtN/A4rOGrVCZlNzTFZ52iSfwTC+YVuCz X-Received: by 2002:a17:906:468d:b0:8f3:dc49:d8eb with SMTP id a13-20020a170906468d00b008f3dc49d8ebmr835245ejr.71.1680643715612; Tue, 04 Apr 2023 14:28:35 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1680643715; cv=none; d=google.com; s=arc-20160816; b=NI+YbVZjaOgOoFDpZihw8A4BevElpAJ4ICCnL+ajerjC4DZdODvW71WTDG6APcpAxu fP4P+W/WWSAWCaJ6k1pGxMaFELjT0NYgsdTJw6L5U18ezNK1uNm1Ak3qDqWYL5BdeFF0 16OB4rllusvTZkXCVFWEZd3PlO37BEWMX2cEJVFM3awzYVdtvcV0crmt96auB/sqXAF4 kJ5WYlImzqpXTtKkqHEt5JbKtgjfEuPwhri9slAAmuklcnFzSAjC6ZPoDpVlPYjQ63EQ 101gUCXo02U/Z3Ck7VbiVjej6lQmgOZkiQ9I3edMbWc7cK6O0toDAUKu76QRd6DZ9Wy5 rRAw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:content-transfer-encoding:mime-version :message-id:date:subject:to:from:dkim-signature; bh=+if/oK1oGmXDElFGJrWjoBYG4rtzdXPLni8MlhgqQBc=; b=yeUJG+t6TMkCtIFHQWhuBeqIzHSNIAgTdpNlzQQ8enRkBDsroMTSE38H8FTbHjET6G e/iIymDsHnQb/AvKP92rIkKl1WwESKf29JFll8KJ9jWRv7oWVdgeeMKqASlk065QqSU3 qoq17RPUMP7FMSw+Rg719yzV4mpr1E+K06T67bz25KKXL4rN+BWnd5jT9pm4p/y2Hcl/ pg50fclhc68zwxRZ0dHsti+19OkweoSEfWvejIgkjjgngbXBH3ev7wrl45CrbpGWNbFq 3FMVju1BCbRLxVj/9yoGqDK2C70bFFJ46SB33jnJPc4a4GWRQ/bk2GhtQWRPDjIdwRdv BCrA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@hpe.com header.s=pps0720 header.b=V5hkIuL4; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=hpe.com Received: from out1.vger.email (out1.vger.email. [2620:137:e000::1:20]) by mx.google.com with ESMTP id pv6-20020a170907208600b0092679d231easi7720975ejb.332.2023.04.04.14.28.11; Tue, 04 Apr 2023 14:28:35 -0700 (PDT) Received-SPF: pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) client-ip=2620:137:e000::1:20; Authentication-Results: mx.google.com; dkim=pass header.i=@hpe.com header.s=pps0720 header.b=V5hkIuL4; spf=pass (google.com: domain of linux-kernel-owner@vger.kernel.org designates 2620:137:e000::1:20 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=hpe.com Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S236468AbjDDVPP (ORCPT + 99 others); Tue, 4 Apr 2023 17:15:15 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:51850 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S236270AbjDDVPJ (ORCPT ); Tue, 4 Apr 2023 17:15:09 -0400 Received: from mx0b-002e3701.pphosted.com (mx0b-002e3701.pphosted.com [148.163.143.35]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 832F149EC for ; Tue, 4 Apr 2023 14:15:04 -0700 (PDT) Received: from pps.filterd (m0150245.ppops.net [127.0.0.1]) by mx0b-002e3701.pphosted.com (8.17.1.19/8.17.1.19) with ESMTP id 334KMqXm020217; Tue, 4 Apr 2023 21:14:34 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hpe.com; h=from : to : subject : date : message-id : mime-version : content-transfer-encoding; s=pps0720; bh=+if/oK1oGmXDElFGJrWjoBYG4rtzdXPLni8MlhgqQBc=; b=V5hkIuL4WyI5MduguhZOf6d+rSpfO9tFloPAzHY+XUxaAWDonmEJqPQAVDqJuohC/Zlb A8hbqEBR0yzCm65tqFfKWAgF/vvYGjyL7lIceHxhy5OcrsaWwy1M5T+PXpAYc9i3ZkJD s9apxf3FCbdjL54sGbGy/2675XgcnPOqM77G5G35opiKekdm5xva3GB0LMAnNaiH5/MT Ki9bdGZmYasIV8E0Sep4BouzgbpkWOIZ4Yy5jOfUrGvTjw8ZDyduRBBufFxIwzgzFWGS AN81JfeH0fTqrJBkigzTG7gMGPH33M8jLoTrKjSXKLl4tup4HkvbW8iCNa9jmiOdKvAS aQ== Received: from p1lg14879.it.hpe.com (p1lg14879.it.hpe.com [16.230.97.200]) by mx0b-002e3701.pphosted.com (PPS) with ESMTPS id 3prtvegbcm-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Tue, 04 Apr 2023 21:14:34 +0000 Received: from p1lg14886.dc01.its.hpecorp.net (unknown [10.119.18.237]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by p1lg14879.it.hpe.com (Postfix) with ESMTPS id C3B7113047; Tue, 4 Apr 2023 21:14:33 +0000 (UTC) Received: from dog.eag.rdlabs.hpecorp.net (unknown [16.231.227.36]) by p1lg14886.dc01.its.hpecorp.net (Postfix) with ESMTP id 1D24F81664E; Tue, 4 Apr 2023 21:14:33 +0000 (UTC) Received: by dog.eag.rdlabs.hpecorp.net (Postfix, from userid 200934) id EEAB5302F4727; Tue, 4 Apr 2023 16:14:31 -0500 (CDT) From: Steve Wahl To: Steve Wahl , Dimitri Sivanich , Russ Anderson , Thomas Gleixner , Ingo Molnar , Borislav Petkov , Dave Hansen , x86@kernel.org, "H. Peter Anvin" , linux-kernel@vger.kernel.org Subject: [PATCH v5 0/8] Support sub-NUMA clustering on UV Date: Tue, 4 Apr 2023 16:14:23 -0500 Message-Id: <20230404211431.776248-1-steve.wahl@hpe.com> X-Mailer: git-send-email 2.26.2 MIME-Version: 1.0 X-Proofpoint-GUID: C84M0MZwhvMp7ux8Y-e1e8nwz9mrC7AK X-Proofpoint-ORIG-GUID: C84M0MZwhvMp7ux8Y-e1e8nwz9mrC7AK X-HPE-SCL: -1 X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.254,Aquarius:18.0.942,Hydra:6.0.573,FMLib:17.11.170.22 definitions=2023-04-04_12,2023-04-04_05,2023-02-09_01 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 bulkscore=0 clxscore=1015 malwarescore=0 adultscore=0 impostorscore=0 suspectscore=0 spamscore=0 mlxscore=0 priorityscore=1501 phishscore=0 mlxlogscore=999 lowpriorityscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2303200000 definitions=main-2304040193 X-Spam-Status: No, score=-0.9 required=5.0 tests=DKIMWL_WL_HIGH,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_LOW, RCVD_IN_MSPIKE_H2,SPF_HELO_NONE,SPF_NONE autolearn=unavailable autolearn_force=no version=3.4.6 X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on lindbergh.monkeyblade.net Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org X-getmail-retrieved-from-mailbox: =?utf-8?q?INBOX?= X-GMAIL-THRID: =?utf-8?q?1762282664747028589?= X-GMAIL-MSGID: =?utf-8?q?1762282664747028589?= Sub-NUMA clustering (SNC) invalidates previous assumptions of a 1:1 relationship between blades, sockets, and nodes. Make changes necessary to support this, including some general improvements along the way. Steve Wahl (8): x86/platform/uv: Add platform resolving #defines for misc GAM_MMIOH_REDIRECT* x86/platform/uv: Introduce helper function uv_pnode_to_socket. x86/platform/uv: Fix incorrect mask define use in calc_mmioh_map x86/platform/uv: When searching for minimums, start at INT_MAX not 99999 x86/platform/uv: helper functions for allocating and freeing conversion tables x86/platform/uv: UV support for sub-NUMA clustering x86/platform/uv: Remove remaining BUG_ON() and BUG() calls x86/platform/uv: Update UV[23] platform code for SNC arch/x86/include/asm/uv/uv_hub.h | 32 ++- arch/x86/include/asm/uv/uv_mmrs.h | 18 +- arch/x86/kernel/apic/x2apic_uv_x.c | 318 ++++++++++++++++++----------- 3 files changed, 232 insertions(+), 136 deletions(-)