[0/1] Parallelized build for several packages
| Message ID | 20190220191806.2917-1-wolfgang.apolinarski@ipfire.org |
|---|---|
| Headers |
Return-Path: <development-bounces@lists.ipfire.org> Received: from mail01.ipfire.org (mail01.i.ipfire.org [172.28.1.200]) (using TLSv1.2 with cipher ECDHE-ECDSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail01.ipfire.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by web07.i.ipfire.org (Postfix) with ESMTPS id 2ED0588B5C6 for <patchwork@web07.i.ipfire.org>; Wed, 20 Feb 2019 19:19:06 +0000 (GMT) Received: from mail01.i.ipfire.org (localhost [IPv6:::1]) by mail01.ipfire.org (Postfix) with ESMTP id 444S891rm8z5K71k; Wed, 20 Feb 2019 19:19:05 +0000 (GMT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ipfire.org; s=201801; t=1550690345; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:mime-version:mime-version:content-type: content-transfer-encoding:content-transfer-encoding:in-reply-to: references:list-id:list-unsubscribe:list-subscribe:list-post; bh=mKZf2VfOgj8clwlnc7GJ7nudPXeh31jBPKNjBcBJ7/8=; b=inzYFBI6I2pXuD1alf4dHXnKJmLgsLf6bqTk9dVUiUbZQY2MZSSD3RG+FN87UCbZ0XLs21 9AiEFvmdf/e/fzMkXbSYp/jEEZJtlyxLNswQSKcw8WRF0GjawmjhtVZSjMGhRFU8fg90sE Qc8KvvEv4NaZZViUPyO25gIbnJC68TaGhPx/j0dMME7iPFkmZavtiDCLRemgf3i+UDXS9t MjQRId3GLl/+rxPhlYHdf7Dmoe+3oO/jx7qlHw/Y1EkfSj9jaYej3R13Fw2YJTgNo//Azr rUn23T9YPBOEZVdWQc+JByrK26nN26+VXt2jYtsGtLpPTjmtxyMoR50aNw2gfA== Received: from gentoo-modula.duisburg.apolinarski.de (x4e3138f3.dyn.telefonica.de [78.49.56.243]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mail01.ipfire.org (Postfix) with ESMTPSA id 444S861ShCz5K71b; Wed, 20 Feb 2019 19:19:02 +0000 (GMT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ipfire.org; s=201801; t=1550690342; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:references; bh=mKZf2VfOgj8clwlnc7GJ7nudPXeh31jBPKNjBcBJ7/8=; b=i/yagWrJLGUgANzMNdLa5iUR9wk45jVG7mSGGqM2jiJ0/1+NAVyklCC9Hizz8YwqiYJRMy apL6P0J7GvhKGb3OM9r6+Iom0tWiEKTz4FVGyXD/EE1wlUVG2J5NSriHh5I17ig0a+htbr yPFoGuTkTth/PqxeAHGT/3x6VnVCVPKzT0IZ8zTL/kriK2Fb0lf/aqYcAmTWumzmiigAhF n+pVbdDa7i0AM2+njeMI/fJrH2DWEEqMiJdV9HmytIT0asgmuN9xief4HkkAKL7RG5Gcwq UmdfvfeAtI44b8Ck9kYKSp6v9kz3mhRSl4UJPT3n+/HUC0+orMv+DmkYiFhL1A== From: Wolfgang Apolinarski <wolfgang.apolinarski@ipfire.org> To: development@lists.ipfire.org Subject: [PATCH 0/1] Parallelized build for several packages Date: Wed, 20 Feb 2019 20:18:05 +0100 Message-Id: <20190220191806.2917-1-wolfgang.apolinarski@ipfire.org> X-Mailer: git-send-email 2.19.2 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=4.23 X-Rspamd-Server: mail01.i.ipfire.org Authentication-Results: mail01.ipfire.org; auth=pass smtp.auth=wapolinarski smtp.mailfrom=wolfgang.apolinarski@ipfire.org X-Spamd-Result: default: False [4.23 / 11.00]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_MISSING_CHARSET(2.50)[]; MIME_GOOD(-0.10)[text/plain]; BROKEN_CONTENT_TYPE(1.50)[]; DKIM_SIGNED(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; MID_CONTAINS_FROM(1.00)[]; NEURAL_HAM(-0.67)[-0.223,0]; RCVD_COUNT_ZERO(0.00)[0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:6805, ipnet:78.48.0.0/13, country:DE]; RCVD_TLS_ALL(0.00)[] X-Spam-Level: **** X-BeenThere: development@lists.ipfire.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: IPFire development talk <development.lists.ipfire.org> List-Unsubscribe: <https://lists.ipfire.org/mailman/options/development>, <mailto:development-request@lists.ipfire.org?subject=unsubscribe> List-Archive: <https://lists.ipfire.org/pipermail/development/> List-Post: <mailto:development@lists.ipfire.org> List-Help: <mailto:development-request@lists.ipfire.org?subject=help> List-Subscribe: <https://lists.ipfire.org/mailman/listinfo/development>, <mailto:development-request@lists.ipfire.org?subject=subscribe> Errors-To: development-bounces@lists.ipfire.org Sender: "Development" <development-bounces@lists.ipfire.org> X-Spam: Yes |
Message
Wolfgang Apolinarski
Feb. 21, 2019, 6:18 a.m. UTC
With this patch, I tried to optimize the build (because it really takes a long time if I compile from scratch for testing). Nowadays, most packages are already optimizing for parallel build. I was testing the build on an 8 core system (i.e., MAKETUNING is -j9). I also found out something else, the collectd package build crashes when libstatgrab is already built: https://github.com/collectd/collectd/issues/445 Someone else already noticed this on the list, without discovering the cause. An upgrade of collectd would be required to solve this problem. Since I am not sure for what collectd is actually used (and a major upgrade would be required), I did not perform this. Speed-up: Package | Before | After boost | 1:20:41 | 13:39 cyrus-imapd | 3:50 | 0:48 dnsdist | 5:23 | 1:18 gcc | 46:15 | 11:29 gettext | 9:55 | 4:56 gutenprint | 3:14 | 1:22 ipfire-netboot | 9:33 | 2:07 krb5 | 5:28 | 1:27 lcd4linux | 1:04 | 0:27 netsnmpd | 8:00 | 3:33 nut | 1:59 | 0:21 openssl | 7:57 | 2:37 rrdtool | 1:31 | 0:32 samba | 5:03 | 0:55 slang | 1:04 | 0:19 snort | 5:11 | 0:56 xfsprogs | 5:41 | 1:46 I also marked packages that (in their current version) crash when being built in parallel. I performed multiple builds (and tested the ISO image), so I hope that this patch is reliable for everyone. Nevertheless, please test the patch on different build environments before applying it. Wolfgang Apolinarski (1): Parallelized build for several packages lfs/boost | 2 +- lfs/collectd | 2 +- lfs/cyrus-imapd | 2 +- lfs/dhcp | 2 +- lfs/dnsdist | 2 +- lfs/gcc | 4 ++-- lfs/gettext | 8 ++++---- lfs/groff | 2 +- lfs/gutenprint | 2 +- lfs/ipfire-netboot | 4 ++-- lfs/krb5 | 2 +- lfs/lcd4linux | 2 +- lfs/netpbm | 2 +- lfs/netsnmpd | 2 +- lfs/nut | 2 +- lfs/openssl | 2 +- lfs/rrdtool | 2 +- lfs/samba | 4 ++-- lfs/slang | 2 +- lfs/snort | 2 +- lfs/xfsprogs | 2 +- 21 files changed, 27 insertions(+), 27 deletions(-)